2023-11-11 04:53:17,586 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-11 04:53:17,830 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22 2023-11-11 04:53:17,844 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-11 04:53:17,845 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/cluster_4ad29b40-445f-1468-05dc-b255cb81bdb5, deleteOnExit=true 2023-11-11 04:53:17,845 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-11 04:53:17,846 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/test.cache.data in system properties and HBase conf 2023-11-11 04:53:17,846 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/hadoop.tmp.dir in system properties and HBase conf 2023-11-11 04:53:17,847 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/hadoop.log.dir in system properties and HBase conf 2023-11-11 04:53:17,848 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-11 04:53:17,848 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-11 04:53:17,848 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-11 04:53:17,979 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-11 04:53:18,401 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-11 04:53:18,407 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-11 04:53:18,408 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-11 04:53:18,408 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-11 04:53:18,409 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-11 04:53:18,409 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-11 04:53:18,410 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-11 04:53:18,410 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-11 04:53:18,411 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-11 04:53:18,411 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-11 04:53:18,412 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/nfs.dump.dir in system properties and HBase conf 2023-11-11 04:53:18,412 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/java.io.tmpdir in system properties and HBase conf 2023-11-11 04:53:18,412 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-11 04:53:18,413 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-11 04:53:18,413 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-11 04:53:19,030 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-11 04:53:19,034 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-11 04:53:19,325 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-11 04:53:19,509 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-11 04:53:19,531 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-11 04:53:19,572 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-11 04:53:19,603 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/java.io.tmpdir/Jetty_localhost_39463_hdfs____.hd82h7/webapp 2023-11-11 04:53:19,752 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39463 2023-11-11 04:53:19,763 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-11 04:53:19,763 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-11 04:53:20,308 WARN [Listener at localhost/44941] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-11 04:53:20,412 WARN [Listener at localhost/44941] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-11 04:53:20,437 WARN [Listener at localhost/44941] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-11 04:53:20,445 INFO [Listener at localhost/44941] log.Slf4jLog(67): jetty-6.1.26 2023-11-11 04:53:20,452 INFO [Listener at localhost/44941] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/java.io.tmpdir/Jetty_localhost_35561_datanode____i6mo6t/webapp 2023-11-11 04:53:20,552 INFO [Listener at localhost/44941] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35561 2023-11-11 04:53:21,024 WARN [Listener at localhost/35271] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-11 04:53:21,599 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1147cac0c0917fe: Processing first storage report for DS-3d0d3c6d-8732-4c69-a9d7-6ac2216dce87 from datanode ca1c889f-8459-4f27-b8da-dcf0375e1cfd 2023-11-11 04:53:21,600 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1147cac0c0917fe: from storage DS-3d0d3c6d-8732-4c69-a9d7-6ac2216dce87 node DatanodeRegistration(127.0.0.1:39707, datanodeUuid=ca1c889f-8459-4f27-b8da-dcf0375e1cfd, infoPort=35889, infoSecurePort=0, ipcPort=35271, storageInfo=lv=-57;cid=testClusterID;nsid=580354161;c=1699678399109), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-11 04:53:21,601 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1147cac0c0917fe: Processing first storage report for DS-2b476796-5958-42ba-931f-b080e8555a19 from datanode ca1c889f-8459-4f27-b8da-dcf0375e1cfd 2023-11-11 04:53:21,601 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1147cac0c0917fe: from storage DS-2b476796-5958-42ba-931f-b080e8555a19 node DatanodeRegistration(127.0.0.1:39707, datanodeUuid=ca1c889f-8459-4f27-b8da-dcf0375e1cfd, infoPort=35889, infoSecurePort=0, ipcPort=35271, storageInfo=lv=-57;cid=testClusterID;nsid=580354161;c=1699678399109), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-11 04:53:21,681 DEBUG [Listener at localhost/35271] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22 2023-11-11 04:53:21,789 INFO [Listener at localhost/35271] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/cluster_4ad29b40-445f-1468-05dc-b255cb81bdb5/zookeeper_0, clientPort=61842, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/cluster_4ad29b40-445f-1468-05dc-b255cb81bdb5/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/cluster_4ad29b40-445f-1468-05dc-b255cb81bdb5/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-11 04:53:21,803 INFO [Listener at localhost/35271] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61842 2023-11-11 04:53:21,810 INFO [Listener at localhost/35271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 04:53:21,812 INFO [Listener at localhost/35271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 04:53:22,502 INFO [Listener at localhost/35271] util.FSUtils(471): Created version file at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549 with version=8 2023-11-11 04:53:22,502 INFO [Listener at localhost/35271] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/hbase-staging 2023-11-11 04:53:22,826 INFO [Listener at localhost/35271] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-11 04:53:23,326 INFO [Listener at localhost/35271] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-11 04:53:23,360 INFO [Listener at localhost/35271] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-11 04:53:23,361 INFO [Listener at localhost/35271] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-11 04:53:23,361 INFO [Listener at localhost/35271] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-11 04:53:23,361 INFO [Listener at localhost/35271] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-11 04:53:23,361 INFO [Listener at localhost/35271] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-11 04:53:23,510 INFO [Listener at localhost/35271] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-11 04:53:23,582 DEBUG [Listener at localhost/35271] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-11 04:53:23,673 INFO [Listener at localhost/35271] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38667 2023-11-11 04:53:23,682 INFO [Listener at localhost/35271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 04:53:23,684 INFO [Listener at localhost/35271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 04:53:23,707 INFO [Listener at localhost/35271] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38667 connecting to ZooKeeper ensemble=127.0.0.1:61842 2023-11-11 04:53:23,753 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:386670x0, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-11 04:53:23,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38667-0x101d3796c880000 connected 2023-11-11 04:53:23,788 DEBUG [Listener at localhost/35271] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-11 04:53:23,789 DEBUG [Listener at localhost/35271] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-11 04:53:23,792 DEBUG [Listener at localhost/35271] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-11 04:53:23,800 DEBUG [Listener at localhost/35271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38667 2023-11-11 04:53:23,801 DEBUG [Listener at localhost/35271] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38667 2023-11-11 04:53:23,801 DEBUG [Listener at localhost/35271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38667 2023-11-11 04:53:23,803 DEBUG [Listener at localhost/35271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38667 2023-11-11 04:53:23,803 DEBUG [Listener at localhost/35271] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38667 2023-11-11 04:53:23,809 INFO [Listener at localhost/35271] master.HMaster(444): hbase.rootdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549, hbase.cluster.distributed=false 2023-11-11 04:53:23,880 INFO [Listener at localhost/35271] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-11 04:53:23,880 INFO [Listener at localhost/35271] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-11 04:53:23,881 INFO [Listener at localhost/35271] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-11 04:53:23,881 INFO [Listener at localhost/35271] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-11 04:53:23,881 INFO [Listener at localhost/35271] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-11 04:53:23,881 INFO [Listener at localhost/35271] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-11 04:53:23,886 INFO [Listener at localhost/35271] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-11 04:53:23,890 INFO [Listener at localhost/35271] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43941 2023-11-11 04:53:23,892 INFO [Listener at localhost/35271] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-11 04:53:23,898 DEBUG [Listener at localhost/35271] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-11 04:53:23,899 INFO [Listener at localhost/35271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 04:53:23,903 INFO [Listener at localhost/35271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 04:53:23,905 INFO [Listener at localhost/35271] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43941 connecting to ZooKeeper ensemble=127.0.0.1:61842 2023-11-11 04:53:23,909 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:439410x0, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-11 04:53:23,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43941-0x101d3796c880001 connected 2023-11-11 04:53:23,910 DEBUG [Listener at localhost/35271] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-11 04:53:23,911 DEBUG [Listener at localhost/35271] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-11 04:53:23,912 DEBUG [Listener at localhost/35271] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-11 04:53:23,913 DEBUG [Listener at localhost/35271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43941 2023-11-11 04:53:23,913 DEBUG [Listener at localhost/35271] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43941 2023-11-11 04:53:23,916 DEBUG [Listener at localhost/35271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43941 2023-11-11 04:53:23,917 DEBUG [Listener at localhost/35271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43941 2023-11-11 04:53:23,917 DEBUG [Listener at localhost/35271] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43941 2023-11-11 04:53:23,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38667,1699678402647 2023-11-11 04:53:23,931 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-11 04:53:23,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38667,1699678402647 2023-11-11 04:53:23,952 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-11 04:53:23,952 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-11 04:53:23,952 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 04:53:23,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-11 04:53:23,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38667,1699678402647 from backup master directory 2023-11-11 04:53:23,958 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-11 04:53:23,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38667,1699678402647 2023-11-11 04:53:23,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-11 04:53:23,964 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-11 04:53:23,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38667,1699678402647 2023-11-11 04:53:23,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-11 04:53:23,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-11 04:53:24,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/hbase.id with ID: 73d6b714-0553-45fd-99b2-3a560391b1d9 2023-11-11 04:53:24,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 04:53:24,113 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 04:53:24,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x12880aef to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:53:24,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@223f734d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:53:24,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-11 04:53:24,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-11 04:53:24,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-11 04:53:24,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-11 04:53:24,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-11 04:53:24,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-11 04:53:24,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-11 04:53:24,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/data/master/store-tmp 2023-11-11 04:53:24,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:24,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-11 04:53:24,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 04:53:24,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 04:53:24,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-11 04:53:24,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 04:53:24,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 04:53:24,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-11 04:53:24,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/WALs/jenkins-hbase4.apache.org,38667,1699678402647 2023-11-11 04:53:24,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38667%2C1699678402647, suffix=, logDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/WALs/jenkins-hbase4.apache.org,38667,1699678402647, archiveDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/oldWALs, maxLogs=10 2023-11-11 04:53:24,816 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39707,DS-3d0d3c6d-8732-4c69-a9d7-6ac2216dce87,DISK] 2023-11-11 04:53:24,827 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-11 04:53:24,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/WALs/jenkins-hbase4.apache.org,38667,1699678402647/jenkins-hbase4.apache.org%2C38667%2C1699678402647.1699678404756 2023-11-11 04:53:24,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39707,DS-3d0d3c6d-8732-4c69-a9d7-6ac2216dce87,DISK]] 2023-11-11 04:53:24,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:53:24,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:24,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-11 04:53:24,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-11 04:53:24,964 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-11 04:53:24,972 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-11 04:53:25,003 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-11 04:53:25,014 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:25,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-11 04:53:25,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-11 04:53:25,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-11 04:53:25,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:53:25,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75042056, jitterRate=0.11821377277374268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:53:25,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-11 04:53:25,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-11 04:53:25,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-11 04:53:25,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-11 04:53:25,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-11 04:53:25,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-11 04:53:25,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 45 msec 2023-11-11 04:53:25,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-11 04:53:25,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-11 04:53:25,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-11 04:53:25,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-11 04:53:25,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-11 04:53:25,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-11 04:53:25,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-11 04:53:25,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-11 04:53:25,197 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 04:53:25,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-11 04:53:25,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-11 04:53:25,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-11 04:53:25,222 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-11 04:53:25,222 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-11 04:53:25,222 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 04:53:25,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38667,1699678402647, sessionid=0x101d3796c880000, setting cluster-up flag (Was=false) 2023-11-11 04:53:25,246 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 04:53:25,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-11 04:53:25,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38667,1699678402647 2023-11-11 04:53:25,263 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 04:53:25,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-11 04:53:25,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38667,1699678402647 2023-11-11 04:53:25,275 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/.tmp 2023-11-11 04:53:25,325 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(951): ClusterId : 73d6b714-0553-45fd-99b2-3a560391b1d9 2023-11-11 04:53:25,330 DEBUG [RS:0;jenkins-hbase4:43941] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-11 04:53:25,348 DEBUG [RS:0;jenkins-hbase4:43941] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-11 04:53:25,348 DEBUG [RS:0;jenkins-hbase4:43941] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-11 04:53:25,353 DEBUG [RS:0;jenkins-hbase4:43941] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-11 04:53:25,357 DEBUG [RS:0;jenkins-hbase4:43941] zookeeper.ReadOnlyZKClient(139): Connect 0x68396791 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:53:25,365 DEBUG [RS:0;jenkins-hbase4:43941] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66fe84e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:53:25,366 DEBUG [RS:0;jenkins-hbase4:43941] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62c10ce1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-11 04:53:25,399 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43941 2023-11-11 04:53:25,402 INFO [RS:0;jenkins-hbase4:43941] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-11 04:53:25,402 INFO [RS:0;jenkins-hbase4:43941] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-11 04:53:25,402 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1022): About to register with Master. 2023-11-11 04:53:25,405 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38667,1699678402647 with isa=jenkins-hbase4.apache.org/172.31.14.131:43941, startcode=1699678403879 2023-11-11 04:53:25,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-11 04:53:25,424 DEBUG [RS:0;jenkins-hbase4:43941] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-11 04:53:25,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-11 04:53:25,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-11 04:53:25,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-11 04:53:25,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-11 04:53:25,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-11 04:53:25,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 04:53:25,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-11 04:53:25,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 04:53:25,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1699678435435 2023-11-11 04:53:25,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-11 04:53:25,445 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-11 04:53:25,445 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-11 04:53:25,452 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-11 04:53:25,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-11 04:53:25,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-11 04:53:25,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-11 04:53:25,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-11 04:53:25,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-11 04:53:25,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:25,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-11 04:53:25,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-11 04:53:25,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-11 04:53:25,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-11 04:53:25,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-11 04:53:25,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699678405491,5,FailOnTimeoutGroup] 2023-11-11 04:53:25,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699678405493,5,FailOnTimeoutGroup] 2023-11-11 04:53:25,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:25,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-11 04:53:25,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:25,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:25,497 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53781, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-11 04:53:25,511 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38667] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:25,530 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549 2023-11-11 04:53:25,530 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44941 2023-11-11 04:53:25,530 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-11 04:53:25,536 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-11 04:53:25,538 DEBUG [RS:0;jenkins-hbase4:43941] zookeeper.ZKUtil(162): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:25,538 WARN [RS:0;jenkins-hbase4:43941] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-11 04:53:25,538 INFO [RS:0;jenkins-hbase4:43941] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-11 04:53:25,539 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/WALs/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:25,539 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43941,1699678403879] 2023-11-11 04:53:25,550 DEBUG [RS:0;jenkins-hbase4:43941] zookeeper.ZKUtil(162): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:25,567 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-11 04:53:25,577 INFO [RS:0;jenkins-hbase4:43941] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-11 04:53:25,598 INFO [RS:0;jenkins-hbase4:43941] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-11 04:53:25,603 INFO [RS:0;jenkins-hbase4:43941] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:53:25,603 INFO [RS:0;jenkins-hbase4:43941] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:25,604 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-11 04:53:25,612 INFO [RS:0;jenkins-hbase4:43941] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-11 04:53:25,612 DEBUG [RS:0;jenkins-hbase4:43941] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 04:53:25,613 DEBUG [RS:0;jenkins-hbase4:43941] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 04:53:25,613 DEBUG [RS:0;jenkins-hbase4:43941] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 04:53:25,613 DEBUG [RS:0;jenkins-hbase4:43941] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 04:53:25,613 DEBUG [RS:0;jenkins-hbase4:43941] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 04:53:25,613 DEBUG [RS:0;jenkins-hbase4:43941] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-11 04:53:25,614 DEBUG [RS:0;jenkins-hbase4:43941] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 04:53:25,614 DEBUG [RS:0;jenkins-hbase4:43941] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 04:53:25,614 DEBUG [RS:0;jenkins-hbase4:43941] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 04:53:25,614 DEBUG [RS:0;jenkins-hbase4:43941] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 04:53:25,615 INFO [RS:0;jenkins-hbase4:43941] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:25,615 INFO [RS:0;jenkins-hbase4:43941] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:25,615 INFO [RS:0;jenkins-hbase4:43941] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:25,633 INFO [RS:0;jenkins-hbase4:43941] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-11 04:53:25,635 INFO [RS:0;jenkins-hbase4:43941] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43941,1699678403879-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:25,658 INFO [RS:0;jenkins-hbase4:43941] regionserver.Replication(203): jenkins-hbase4.apache.org,43941,1699678403879 started 2023-11-11 04:53:25,658 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43941,1699678403879, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43941, sessionid=0x101d3796c880001 2023-11-11 04:53:25,658 DEBUG [RS:0;jenkins-hbase4:43941] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-11 04:53:25,659 DEBUG [RS:0;jenkins-hbase4:43941] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:25,659 DEBUG [RS:0;jenkins-hbase4:43941] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43941,1699678403879' 2023-11-11 04:53:25,659 DEBUG [RS:0;jenkins-hbase4:43941] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:25,660 DEBUG [RS:0;jenkins-hbase4:43941] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:25,660 DEBUG [RS:0;jenkins-hbase4:43941] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-11 04:53:25,661 DEBUG [RS:0;jenkins-hbase4:43941] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-11 04:53:25,661 DEBUG [RS:0;jenkins-hbase4:43941] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:25,661 DEBUG [RS:0;jenkins-hbase4:43941] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43941,1699678403879' 2023-11-11 04:53:25,661 DEBUG [RS:0;jenkins-hbase4:43941] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-11 04:53:25,662 DEBUG [RS:0;jenkins-hbase4:43941] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-11 04:53:25,662 DEBUG [RS:0;jenkins-hbase4:43941] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-11 04:53:25,663 INFO [RS:0;jenkins-hbase4:43941] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-11 04:53:25,663 INFO [RS:0;jenkins-hbase4:43941] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-11 04:53:25,775 INFO [RS:0;jenkins-hbase4:43941] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43941%2C1699678403879, suffix=, logDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/WALs/jenkins-hbase4.apache.org,43941,1699678403879, archiveDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/oldWALs, maxLogs=32 2023-11-11 04:53:25,796 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39707,DS-3d0d3c6d-8732-4c69-a9d7-6ac2216dce87,DISK] 2023-11-11 04:53:25,803 INFO [RS:0;jenkins-hbase4:43941] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/WALs/jenkins-hbase4.apache.org,43941,1699678403879/jenkins-hbase4.apache.org%2C43941%2C1699678403879.1699678405777 2023-11-11 04:53:25,803 DEBUG [RS:0;jenkins-hbase4:43941] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39707,DS-3d0d3c6d-8732-4c69-a9d7-6ac2216dce87,DISK]] 2023-11-11 04:53:25,907 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-11 04:53:25,908 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-11 04:53:25,908 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549 2023-11-11 04:53:26,322 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:26,325 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-11 04:53:26,328 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/info 2023-11-11 04:53:26,329 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-11 04:53:26,330 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:26,331 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-11 04:53:26,334 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/rep_barrier 2023-11-11 04:53:26,335 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-11 04:53:26,336 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:26,336 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-11 04:53:26,339 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/table 2023-11-11 04:53:26,339 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-11 04:53:26,340 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:26,341 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740 2023-11-11 04:53:26,342 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740 2023-11-11 04:53:26,346 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-11 04:53:26,348 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-11 04:53:26,352 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:53:26,353 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60940223, jitterRate=-0.0919199138879776}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-11 04:53:26,353 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-11 04:53:26,353 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-11 04:53:26,353 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-11 04:53:26,353 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-11 04:53:26,353 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-11 04:53:26,353 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-11 04:53:26,354 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-11 04:53:26,354 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-11 04:53:26,358 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-11 04:53:26,359 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-11 04:53:26,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-11 04:53:26,378 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-11 04:53:26,381 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-11 04:53:26,533 DEBUG [jenkins-hbase4:38667] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-11 04:53:26,536 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43941,1699678403879, state=OPENING 2023-11-11 04:53:26,544 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-11 04:53:26,547 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 04:53:26,547 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-11 04:53:26,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:53:26,736 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:26,738 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-11 04:53:26,742 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-11 04:53:26,755 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-11 04:53:26,755 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-11 04:53:26,759 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43941%2C1699678403879.meta, suffix=.meta, logDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/WALs/jenkins-hbase4.apache.org,43941,1699678403879, archiveDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/oldWALs, maxLogs=32 2023-11-11 04:53:26,778 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39707,DS-3d0d3c6d-8732-4c69-a9d7-6ac2216dce87,DISK] 2023-11-11 04:53:26,782 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/WALs/jenkins-hbase4.apache.org,43941,1699678403879/jenkins-hbase4.apache.org%2C43941%2C1699678403879.meta.1699678406760.meta 2023-11-11 04:53:26,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39707,DS-3d0d3c6d-8732-4c69-a9d7-6ac2216dce87,DISK]] 2023-11-11 04:53:26,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:53:26,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-11 04:53:26,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-11 04:53:26,806 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-11 04:53:26,811 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-11 04:53:26,811 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:26,812 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-11 04:53:26,812 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-11 04:53:26,814 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-11 04:53:26,816 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/info 2023-11-11 04:53:26,816 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/info 2023-11-11 04:53:26,817 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-11 04:53:26,817 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:26,818 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-11 04:53:26,819 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/rep_barrier 2023-11-11 04:53:26,819 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/rep_barrier 2023-11-11 04:53:26,820 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-11 04:53:26,821 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:26,821 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-11 04:53:26,822 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/table 2023-11-11 04:53:26,822 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/table 2023-11-11 04:53:26,823 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-11 04:53:26,824 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:26,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740 2023-11-11 04:53:26,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740 2023-11-11 04:53:26,831 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-11 04:53:26,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-11 04:53:26,835 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74710683, jitterRate=0.1132759302854538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-11 04:53:26,836 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-11 04:53:26,845 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1699678406728 2023-11-11 04:53:26,863 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-11 04:53:26,863 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-11 04:53:26,864 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43941,1699678403879, state=OPEN 2023-11-11 04:53:26,870 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-11 04:53:26,871 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-11 04:53:26,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-11 04:53:26,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43941,1699678403879 in 321 msec 2023-11-11 04:53:26,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-11 04:53:26,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 511 msec 2023-11-11 04:53:26,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5580 sec 2023-11-11 04:53:26,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1699678406888, completionTime=-1 2023-11-11 04:53:26,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-11 04:53:26,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-11 04:53:26,970 DEBUG [hconnection-0x6ef5f838-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:53:26,973 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:53:26,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-11 04:53:26,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1699678466993 2023-11-11 04:53:26,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1699678526993 2023-11-11 04:53:26,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 104 msec 2023-11-11 04:53:27,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38667,1699678402647-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:27,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38667,1699678402647-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:27,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38667,1699678402647-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:27,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38667, period=300000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:27,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-11 04:53:27,026 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-11 04:53:27,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-11 04:53:27,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-11 04:53:27,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-11 04:53:27,049 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:53:27,052 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:53:27,074 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24 2023-11-11 04:53:27,077 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24 empty. 2023-11-11 04:53:27,078 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24 2023-11-11 04:53:27,078 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-11 04:53:27,515 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-11 04:53:27,518 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0137cb0f6ae4fdb8385e1c97257ced24, NAME => 'hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:53:27,534 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:27,535 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 0137cb0f6ae4fdb8385e1c97257ced24, disabling compactions & flushes 2023-11-11 04:53:27,535 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:53:27,535 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:53:27,535 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. after waiting 0 ms 2023-11-11 04:53:27,535 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:53:27,535 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:53:27,535 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 0137cb0f6ae4fdb8385e1c97257ced24: 2023-11-11 04:53:27,540 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:53:27,554 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699678407543"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678407543"}]},"ts":"1699678407543"} 2023-11-11 04:53:27,580 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 04:53:27,582 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:53:27,588 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678407582"}]},"ts":"1699678407582"} 2023-11-11 04:53:27,592 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-11 04:53:27,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0137cb0f6ae4fdb8385e1c97257ced24, ASSIGN}] 2023-11-11 04:53:27,603 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0137cb0f6ae4fdb8385e1c97257ced24, ASSIGN 2023-11-11 04:53:27,605 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0137cb0f6ae4fdb8385e1c97257ced24, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:53:27,756 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0137cb0f6ae4fdb8385e1c97257ced24, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:27,756 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699678407756"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678407756"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678407756"}]},"ts":"1699678407756"} 2023-11-11 04:53:27,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0137cb0f6ae4fdb8385e1c97257ced24, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:53:27,914 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:27,920 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:53:27,920 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0137cb0f6ae4fdb8385e1c97257ced24, NAME => 'hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:53:27,921 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0137cb0f6ae4fdb8385e1c97257ced24 2023-11-11 04:53:27,921 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:27,921 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0137cb0f6ae4fdb8385e1c97257ced24 2023-11-11 04:53:27,921 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0137cb0f6ae4fdb8385e1c97257ced24 2023-11-11 04:53:27,923 INFO [StoreOpener-0137cb0f6ae4fdb8385e1c97257ced24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0137cb0f6ae4fdb8385e1c97257ced24 2023-11-11 04:53:27,926 DEBUG [StoreOpener-0137cb0f6ae4fdb8385e1c97257ced24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24/info 2023-11-11 04:53:27,926 DEBUG [StoreOpener-0137cb0f6ae4fdb8385e1c97257ced24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24/info 2023-11-11 04:53:27,926 INFO [StoreOpener-0137cb0f6ae4fdb8385e1c97257ced24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0137cb0f6ae4fdb8385e1c97257ced24 columnFamilyName info 2023-11-11 04:53:27,927 INFO [StoreOpener-0137cb0f6ae4fdb8385e1c97257ced24-1] regionserver.HStore(310): Store=0137cb0f6ae4fdb8385e1c97257ced24/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:27,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24 2023-11-11 04:53:27,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24 2023-11-11 04:53:27,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0137cb0f6ae4fdb8385e1c97257ced24 2023-11-11 04:53:27,938 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:53:27,939 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0137cb0f6ae4fdb8385e1c97257ced24; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74178424, jitterRate=0.10534465312957764}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:53:27,939 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0137cb0f6ae4fdb8385e1c97257ced24: 2023-11-11 04:53:27,941 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24., pid=6, masterSystemTime=1699678407914 2023-11-11 04:53:27,945 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:53:27,945 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:53:27,946 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0137cb0f6ae4fdb8385e1c97257ced24, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:27,947 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699678407946"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678407946"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678407946"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678407946"}]},"ts":"1699678407946"} 2023-11-11 04:53:27,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-11 04:53:27,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0137cb0f6ae4fdb8385e1c97257ced24, server=jenkins-hbase4.apache.org,43941,1699678403879 in 189 msec 2023-11-11 04:53:27,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-11 04:53:27,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0137cb0f6ae4fdb8385e1c97257ced24, ASSIGN in 354 msec 2023-11-11 04:53:27,959 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:53:27,959 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678407959"}]},"ts":"1699678407959"} 2023-11-11 04:53:27,962 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-11 04:53:27,966 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:53:27,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 929 msec 2023-11-11 04:53:28,050 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-11 04:53:28,053 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-11 04:53:28,053 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 04:53:28,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-11 04:53:28,116 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-11 04:53:28,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 43 msec 2023-11-11 04:53:28,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-11 04:53:28,154 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-11 04:53:28,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-11-11 04:53:28,169 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-11 04:53:28,173 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-11 04:53:28,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.211sec 2023-11-11 04:53:28,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-11 04:53:28,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-11 04:53:28,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-11 04:53:28,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38667,1699678402647-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-11 04:53:28,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38667,1699678402647-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-11 04:53:28,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-11 04:53:28,229 DEBUG [Listener at localhost/35271] zookeeper.ReadOnlyZKClient(139): Connect 0x0e51ea3b to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:53:28,235 DEBUG [Listener at localhost/35271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f9c4d78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:53:28,248 DEBUG [hconnection-0x13db0c6a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:53:28,263 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:53:28,276 INFO [Listener at localhost/35271] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38667,1699678402647 2023-11-11 04:53:28,279 DEBUG [Listener at localhost/35271] zookeeper.ReadOnlyZKClient(139): Connect 0x75a9267a to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:53:28,284 DEBUG [Listener at localhost/35271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@247479d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:53:28,284 INFO [Listener at localhost/35271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 04:53:28,353 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=214, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=296, ProcessCount=169, AvailableMemoryMB=2704 2023-11-11 04:53:28,365 DEBUG [Listener at localhost/35271] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:53:28,369 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:53:28,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 04:53:28,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:28,386 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:53:28,389 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:53:28,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-11 04:53:28,391 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:28,393 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9 empty. 2023-11-11 04:53:28,395 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:28,395 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-11 04:53:28,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-11 04:53:28,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-11 04:53:28,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-11 04:53:28,817 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-11 04:53:28,819 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3b5411216f3882b858e02206c99a35d9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:53:28,855 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:28,855 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 3b5411216f3882b858e02206c99a35d9, disabling compactions & flushes 2023-11-11 04:53:28,855 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:28,855 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:28,855 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. after waiting 0 ms 2023-11-11 04:53:28,855 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:28,855 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:28,855 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:28,860 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:53:28,862 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699678408862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678408862"}]},"ts":"1699678408862"} 2023-11-11 04:53:28,865 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 04:53:28,866 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:53:28,867 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678408866"}]},"ts":"1699678408866"} 2023-11-11 04:53:28,869 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-11 04:53:28,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3b5411216f3882b858e02206c99a35d9, ASSIGN}] 2023-11-11 04:53:28,878 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3b5411216f3882b858e02206c99a35d9, ASSIGN 2023-11-11 04:53:28,880 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3b5411216f3882b858e02206c99a35d9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:53:29,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-11 04:53:29,031 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3b5411216f3882b858e02206c99a35d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:29,031 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699678409031"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678409031"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678409031"}]},"ts":"1699678409031"} 2023-11-11 04:53:29,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 3b5411216f3882b858e02206c99a35d9, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:53:29,187 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:29,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:29,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3b5411216f3882b858e02206c99a35d9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:53:29,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:29,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:29,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:29,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:29,198 INFO [StoreOpener-3b5411216f3882b858e02206c99a35d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:29,200 DEBUG [StoreOpener-3b5411216f3882b858e02206c99a35d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1 2023-11-11 04:53:29,200 DEBUG [StoreOpener-3b5411216f3882b858e02206c99a35d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1 2023-11-11 04:53:29,203 INFO [StoreOpener-3b5411216f3882b858e02206c99a35d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b5411216f3882b858e02206c99a35d9 columnFamilyName family1 2023-11-11 04:53:29,206 INFO [StoreOpener-3b5411216f3882b858e02206c99a35d9-1] regionserver.HStore(310): Store=3b5411216f3882b858e02206c99a35d9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:29,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:29,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:29,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:29,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:53:29,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3b5411216f3882b858e02206c99a35d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71578017, jitterRate=0.06659556925296783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:53:29,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:29,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9., pid=11, masterSystemTime=1699678409187 2023-11-11 04:53:29,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:29,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:29,223 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3b5411216f3882b858e02206c99a35d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:29,224 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699678409223"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678409223"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678409223"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678409223"}]},"ts":"1699678409223"} 2023-11-11 04:53:29,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-11 04:53:29,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 3b5411216f3882b858e02206c99a35d9, server=jenkins-hbase4.apache.org,43941,1699678403879 in 192 msec 2023-11-11 04:53:29,233 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-11 04:53:29,233 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3b5411216f3882b858e02206c99a35d9, ASSIGN in 354 msec 2023-11-11 04:53:29,234 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:53:29,235 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678409234"}]},"ts":"1699678409234"} 2023-11-11 04:53:29,237 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-11 04:53:29,241 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:53:29,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 859 msec 2023-11-11 04:53:29,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-11 04:53:29,516 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-11 04:53:29,540 DEBUG [hconnection-0x637d7e04-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:53:29,543 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:53:29,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:29,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:29,747 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:29,747 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:29,748 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 04:53:29,748 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 04:53:29,750 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:29,750 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:29,755 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:29,755 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:29,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:29,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:29,756 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:29,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:29,756 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:29,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:29,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:29,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:29,758 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:29,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:29,760 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 04:53:29,760 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:29,761 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 04:53:29,763 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:29,763 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:29,764 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. started... 2023-11-11 04:53:29,763 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:29,765 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b5411216f3882b858e02206c99a35d9 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 04:53:30,343 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130fc5b1d44b38a4658926d0694d39504d6 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130fc5b1d44b38a4658926d0694d39504d6 2023-11-11 04:53:30,357 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/e8823053f98f432a9f1d4f009718aabc 2023-11-11 04:53:30,367 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/e8823053f98f432a9f1d4f009718aabc as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/e8823053f98f432a9f1d4f009718aabc 2023-11-11 04:53:30,375 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/e8823053f98f432a9f1d4f009718aabc, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-11 04:53:30,378 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 3b5411216f3882b858e02206c99a35d9 in 613ms, sequenceid=5, compaction requested=false 2023-11-11 04:53:30,380 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:30,383 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:30,383 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:30,383 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:30,383 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:30,383 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,383 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 04:53:30,383 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 04:53:30,386 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,386 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:30,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:30,386 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,386 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:30,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:30,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:30,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:30,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 04:53:30,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57cb8d5c[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:30,389 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 04:53:30,389 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,390 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,391 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 04:53:30,391 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 04:53:30,391 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:30,391 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,391 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:30,395 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,395 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 04:53:30,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:30,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:30,395 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:30,395 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 04:53:30,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:30,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:30,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:30,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:30,399 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 04:53:30,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 04:53:30,399 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:30,400 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:30,400 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,400 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:30,403 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,403 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,403 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:30,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:30,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:30,404 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:30,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,406 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:30,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,414 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,414 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,414 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,414 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:30,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:30,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:30,414 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:30,414 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,414 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,415 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,415 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,415 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:30,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:30,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:30,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:30,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:30,417 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:30,417 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:30,517 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:30,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:30,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:30,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:30,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,535 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:30,535 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:30,535 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 04:53:30,535 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 04:53:30,536 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,536 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,542 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:30,542 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:30,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:30,543 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:30,543 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,544 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 04:53:30,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:30,545 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 04:53:30,545 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:30,545 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 04:53:30,545 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:30,545 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:30,545 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:30,545 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. started... 2023-11-11 04:53:30,546 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b5411216f3882b858e02206c99a35d9 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 04:53:30,975 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288e7caf115a124e60b987deef972ec215 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511288e7caf115a124e60b987deef972ec215 2023-11-11 04:53:31,391 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/eb3949d76481447a8956336ebb87f1dc 2023-11-11 04:53:31,400 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/eb3949d76481447a8956336ebb87f1dc as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/eb3949d76481447a8956336ebb87f1dc 2023-11-11 04:53:31,407 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/eb3949d76481447a8956336ebb87f1dc, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 04:53:31,409 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 3b5411216f3882b858e02206c99a35d9 in 863ms, sequenceid=9, compaction requested=false 2023-11-11 04:53:31,409 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:31,409 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:31,409 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:31,410 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:31,410 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,410 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 04:53:31,410 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 04:53:31,413 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,413 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:31,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:31,413 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,413 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:31,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:31,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:31,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:31,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 04:53:31,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43bee9e6[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:31,416 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 04:53:31,416 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,417 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,417 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 04:53:31,417 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 04:53:31,417 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,418 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:31,418 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:31,420 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 04:53:31,420 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,420 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:31,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:31,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:31,420 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 04:53:31,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:31,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:31,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:31,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:31,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 04:53:31,424 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 04:53:31,424 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:31,424 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:31,424 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,424 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:31,428 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,428 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:31,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:31,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,428 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:31,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:31,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:31,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:31,429 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:31,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,432 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:31,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,437 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,437 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,437 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,437 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:31,437 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:31,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:31,437 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,437 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:31,437 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,437 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,437 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:31,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:31,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:31,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:31,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:31,438 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:31,438 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:31,539 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:31,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:31,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:31,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:31,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,551 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:31,551 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:31,552 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 04:53:31,552 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 04:53:31,552 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,552 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,554 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,554 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:31,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:31,555 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:31,555 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,556 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,556 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 04:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:31,557 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 04:53:31,557 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:31,557 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 04:53:31,557 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:31,557 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:31,557 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:31,557 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. started... 2023-11-11 04:53:31,557 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b5411216f3882b858e02206c99a35d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:31,574 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-11 04:53:31,577 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-11 04:53:31,988 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ceaeacd2a727460f880635c78270de4d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ceaeacd2a727460f880635c78270de4d 2023-11-11 04:53:32,340 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:53:32,402 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/49a132007dd24316b5ad387245045710 2023-11-11 04:53:32,413 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/49a132007dd24316b5ad387245045710 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/49a132007dd24316b5ad387245045710 2023-11-11 04:53:32,423 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/49a132007dd24316b5ad387245045710, entries=1, sequenceid=13, filesize=5.0 K 2023-11-11 04:53:32,425 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b5411216f3882b858e02206c99a35d9 in 868ms, sequenceid=13, compaction requested=true 2023-11-11 04:53:32,425 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:32,425 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:32,425 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:32,425 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:32,425 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,425 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 04:53:32,425 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 04:53:32,428 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,428 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:32,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 04:53:32,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7742c068[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:32,431 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 04:53:32,431 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,433 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 04:53:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 04:53:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:32,433 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,433 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:32,437 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,437 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 04:53:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:32,437 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:32,437 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 04:53:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:32,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 04:53:32,441 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 04:53:32,441 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:32,441 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:32,441 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,442 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:32,445 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,445 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:32,446 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:32,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,451 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,454 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:32,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,460 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,460 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,460 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:32,460 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:32,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:32,460 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,460 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,460 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,460 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,460 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:32,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:32,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:32,461 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:32,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:32,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:32,462 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:32,462 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:32,562 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:32,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:32,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:32,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:32,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,574 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:32,574 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:32,575 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 04:53:32,575 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 04:53:32,575 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,575 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,577 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:32,577 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:32,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:32,578 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:32,578 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:32,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:32,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,579 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 04:53:32,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:32,579 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 04:53:32,579 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:32,580 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 04:53:32,580 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:32,580 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:32,580 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:32,580 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. started... 2023-11-11 04:53:32,580 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b5411216f3882b858e02206c99a35d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:32,822 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-11 04:53:32,823 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-11 04:53:33,006 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053d3f33cd9f2d422997759059dd2262a5 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512053d3f33cd9f2d422997759059dd2262a5 2023-11-11 04:53:33,425 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/f74694820f9b402c8a1f4001147e612e 2023-11-11 04:53:33,440 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/f74694820f9b402c8a1f4001147e612e as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/f74694820f9b402c8a1f4001147e612e 2023-11-11 04:53:33,450 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/f74694820f9b402c8a1f4001147e612e, entries=1, sequenceid=17, filesize=5.0 K 2023-11-11 04:53:33,451 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b5411216f3882b858e02206c99a35d9 in 871ms, sequenceid=17, compaction requested=true 2023-11-11 04:53:33,451 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:33,451 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:33,451 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:33,452 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:33,452 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,452 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 04:53:33,453 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 04:53:33,459 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,460 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:33,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:33,461 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:33,461 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:33,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:33,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:33,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 04:53:33,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2787e7d1[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:33,463 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 04:53:33,463 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,465 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,465 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 04:53:33,465 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 04:53:33,465 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:33,465 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,465 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:33,467 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 04:53:33,468 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:33,468 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,468 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 04:53:33,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:33,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:33,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:33,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:33,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:33,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:33,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 04:53:33,473 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 04:53:33,473 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:33,473 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:33,473 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,473 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:33,478 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,478 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:33,478 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:33,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:33,480 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:33,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,481 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:33,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,489 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,489 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,489 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,489 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:33,489 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:33,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:33,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:33,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:33,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:33,490 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,490 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:33,490 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,491 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,491 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,491 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:33,491 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:33,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:33,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:33,591 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:33,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:33,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:33,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:33,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,603 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:33,603 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:33,603 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 04:53:33,603 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 04:53:33,604 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,604 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,607 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,607 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:33,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:33,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:33,607 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:33,607 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:33,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:33,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,609 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,609 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 04:53:33,609 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:33,609 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 04:53:33,609 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:33,610 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 04:53:33,610 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:33,610 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:33,610 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:33,611 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. started... 2023-11-11 04:53:33,611 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b5411216f3882b858e02206c99a35d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:34,038 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d47bacd61ab84181ade576d056a8bec2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228d47bacd61ab84181ade576d056a8bec2 2023-11-11 04:53:34,055 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/bd4c3f2cd9734cb99d7ecfa0fa97c7d0 2023-11-11 04:53:34,064 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/bd4c3f2cd9734cb99d7ecfa0fa97c7d0 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/bd4c3f2cd9734cb99d7ecfa0fa97c7d0 2023-11-11 04:53:34,072 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/bd4c3f2cd9734cb99d7ecfa0fa97c7d0, entries=1, sequenceid=21, filesize=5.0 K 2023-11-11 04:53:34,074 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b5411216f3882b858e02206c99a35d9 in 463ms, sequenceid=21, compaction requested=true 2023-11-11 04:53:34,074 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:34,074 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:34,074 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 04:53:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 04:53:34,078 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,078 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:34,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:34,079 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,079 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:34,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:34,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:34,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:34,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 04:53:34,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cad2f10[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:34,082 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 04:53:34,082 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,084 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 04:53:34,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 04:53:34,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:34,084 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,084 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:34,086 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 04:53:34,086 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,086 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:34,087 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 04:53:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:34,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:34,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 04:53:34,091 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 04:53:34,092 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:34,092 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:34,092 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,092 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:34,095 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,095 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:34,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,095 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:34,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:34,096 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,099 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:34,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,107 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,107 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,107 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,107 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,107 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,107 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,107 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:34,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 04:53:34,107 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:34,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:34,107 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:34,107 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:34,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:34,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:34,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:34,109 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:34,109 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:34,209 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:34,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:34,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:34,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:34,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,220 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:34,220 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:34,221 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 04:53:34,221 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 04:53:34,222 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,222 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,223 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,223 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:34,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:34,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:34,224 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:34,224 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:34,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,225 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,225 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 04:53:34,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:34,225 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 04:53:34,225 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:34,226 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 04:53:34,226 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:34,226 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:34,226 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:34,226 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. started... 2023-11-11 04:53:34,226 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b5411216f3882b858e02206c99a35d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:34,648 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b60858b797d54a139ce81f9dccb3ba0d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231b60858b797d54a139ce81f9dccb3ba0d 2023-11-11 04:53:35,058 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/4986dd95b65143d88bed3a1b1511ab3b 2023-11-11 04:53:35,069 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/4986dd95b65143d88bed3a1b1511ab3b as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4986dd95b65143d88bed3a1b1511ab3b 2023-11-11 04:53:35,078 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4986dd95b65143d88bed3a1b1511ab3b, entries=1, sequenceid=25, filesize=5.0 K 2023-11-11 04:53:35,080 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b5411216f3882b858e02206c99a35d9 in 854ms, sequenceid=25, compaction requested=true 2023-11-11 04:53:35,080 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:35,080 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:35,081 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:35,081 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,081 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 04:53:35,081 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 04:53:35,083 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,083 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:35,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:35,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:35,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:35,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 04:53:35,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@186812ba[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:35,088 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 04:53:35,089 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,090 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,091 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 04:53:35,091 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 04:53:35,091 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:35,091 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,091 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:35,094 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 04:53:35,094 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:35,094 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,094 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 04:53:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:35,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:35,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:35,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:35,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:35,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 04:53:35,098 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 04:53:35,099 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:35,099 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:35,099 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,099 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:35,101 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,101 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:35,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,101 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:35,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:35,102 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:35,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,104 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:35,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:35,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:35,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:35,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:35,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:35,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,108 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:35,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 04:53:35,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:35,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:35,109 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:35,109 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:35,210 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:35,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:35,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:35,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:35,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,221 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:35,221 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:35,222 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 04:53:35,222 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 04:53:35,222 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,222 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,225 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,225 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:35,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:35,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:35,225 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:35,225 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:35,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:35,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,227 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,227 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 04:53:35,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:35,227 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 04:53:35,227 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:35,228 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 04:53:35,228 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:35,228 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:35,228 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:35,228 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. started... 2023-11-11 04:53:35,228 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b5411216f3882b858e02206c99a35d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:35,651 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601015e895e0091d4477aa20a760ec153fbbd to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015e895e0091d4477aa20a760ec153fbbd 2023-11-11 04:53:36,060 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/61e4d099ed0e4cbfa2fa3766e7cb8499 2023-11-11 04:53:36,068 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/61e4d099ed0e4cbfa2fa3766e7cb8499 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/61e4d099ed0e4cbfa2fa3766e7cb8499 2023-11-11 04:53:36,077 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/61e4d099ed0e4cbfa2fa3766e7cb8499, entries=1, sequenceid=29, filesize=5.0 K 2023-11-11 04:53:36,078 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b5411216f3882b858e02206c99a35d9 in 850ms, sequenceid=29, compaction requested=true 2023-11-11 04:53:36,078 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:36,079 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:36,079 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:36,079 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:36,079 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,079 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 04:53:36,079 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 04:53:36,085 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,085 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:36,085 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,085 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:36,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 04:53:36,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7948c05f[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:36,088 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 04:53:36,088 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,090 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,090 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 04:53:36,090 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 04:53:36,090 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:36,091 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,091 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:36,092 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 04:53:36,092 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,092 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:36,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:36,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:36,092 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 04:53:36,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:36,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:36,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:36,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:36,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 04:53:36,097 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 04:53:36,097 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:36,097 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:36,097 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,097 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:36,100 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,100 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:36,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:36,100 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:36,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:36,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:36,102 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,104 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,107 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:36,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:36,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:36,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:36,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 04:53:36,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:36,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:36,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:36,108 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:36,108 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:36,109 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,109 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,109 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,109 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,109 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,109 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:36,109 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:36,209 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:36,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:36,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:36,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:36,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,220 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:36,220 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:36,221 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 04:53:36,221 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 04:53:36,221 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,221 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,223 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:36,223 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:36,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:36,223 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:36,223 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:36,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:36,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,224 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,225 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 04:53:36,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:36,225 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 04:53:36,225 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:36,225 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 04:53:36,225 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:36,225 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:36,225 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:36,225 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. started... 2023-11-11 04:53:36,226 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b5411216f3882b858e02206c99a35d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:36,649 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031925b524b5b44a8bb50882ca4a3537a7 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031925b524b5b44a8bb50882ca4a3537a7 2023-11-11 04:53:37,059 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/24824ba3dfe04d14b44ab61cfb262cb4 2023-11-11 04:53:37,066 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/24824ba3dfe04d14b44ab61cfb262cb4 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/24824ba3dfe04d14b44ab61cfb262cb4 2023-11-11 04:53:37,073 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/24824ba3dfe04d14b44ab61cfb262cb4, entries=1, sequenceid=33, filesize=5.0 K 2023-11-11 04:53:37,074 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b5411216f3882b858e02206c99a35d9 in 848ms, sequenceid=33, compaction requested=true 2023-11-11 04:53:37,074 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:37,074 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:37,074 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:37,075 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:37,075 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,075 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 04:53:37,075 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 04:53:37,077 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,077 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:37,078 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:37,078 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:37,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 04:53:37,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61e909c8[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:37,080 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 04:53:37,080 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,082 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,082 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 04:53:37,082 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 04:53:37,082 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:37,082 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,082 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:37,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 04:53:37,084 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:37,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:37,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:37,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 04:53:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:37,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 04:53:37,088 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 04:53:37,088 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:37,088 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:37,088 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,088 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:37,090 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,090 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:37,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:37,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,090 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:37,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:37,091 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:37,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,093 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:37,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,096 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,096 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:37,096 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:37,096 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,096 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:37,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:37,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:37,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:37,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 04:53:37,096 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,096 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,096 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,096 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,096 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:37,097 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:37,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:37,097 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:37,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:37,197 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:37,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:37,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:37,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:37,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,211 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:37,211 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:37,211 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 04:53:37,211 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 04:53:37,212 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,212 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,215 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:37,215 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:37,216 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:37,216 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,217 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,222 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 04:53:37,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:37,223 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 04:53:37,223 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:37,224 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 04:53:37,228 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:37,228 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:37,228 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:37,229 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. started... 2023-11-11 04:53:37,229 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b5411216f3882b858e02206c99a35d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:37,660 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a420cadb9faa4854aff82b393c46c3ef to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907a420cadb9faa4854aff82b393c46c3ef 2023-11-11 04:53:38,070 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/c1cdfd75f1e74ca3be7a20c3f1025aa0 2023-11-11 04:53:38,078 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/c1cdfd75f1e74ca3be7a20c3f1025aa0 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/c1cdfd75f1e74ca3be7a20c3f1025aa0 2023-11-11 04:53:38,085 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/c1cdfd75f1e74ca3be7a20c3f1025aa0, entries=1, sequenceid=37, filesize=5.0 K 2023-11-11 04:53:38,086 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b5411216f3882b858e02206c99a35d9 in 857ms, sequenceid=37, compaction requested=true 2023-11-11 04:53:38,086 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:38,086 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:38,087 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:38,087 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:38,087 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,087 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 04:53:38,087 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 04:53:38,089 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,089 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:38,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:38,090 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,090 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:38,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:38,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 04:53:38,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24f96f4a[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:38,091 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 04:53:38,092 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,093 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,093 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 04:53:38,093 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 04:53:38,093 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:38,093 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,093 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:38,095 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 04:53:38,095 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,095 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:38,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:38,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:38,095 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 04:53:38,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:38,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:38,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 04:53:38,100 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 04:53:38,100 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:38,100 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:38,100 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,100 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:38,103 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,103 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,103 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:38,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:38,104 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:38,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,106 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:38,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,112 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,112 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,112 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,112 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,112 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:38,112 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:38,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:38,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:38,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:38,112 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:38,112 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,112 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:38,113 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,113 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:38,113 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:38,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:38,213 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:38,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:38,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:38,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:38,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,227 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:38,227 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:38,228 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 04:53:38,228 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 04:53:38,228 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,228 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,230 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:38,230 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:38,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:38,230 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,230 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:38,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:38,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,231 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,232 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 04:53:38,232 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,232 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 04:53:38,232 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:38,233 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 04:53:38,233 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:38,233 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:38,233 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:38,233 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. started... 2023-11-11 04:53:38,233 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b5411216f3882b858e02206c99a35d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:38,255 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112062a4bc9450b04517b69cec1c5c2e68c1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112062a4bc9450b04517b69cec1c5c2e68c1 2023-11-11 04:53:38,263 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/4e919bb7785946559f661445b57f0d20 2023-11-11 04:53:38,270 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/4e919bb7785946559f661445b57f0d20 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4e919bb7785946559f661445b57f0d20 2023-11-11 04:53:38,277 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4e919bb7785946559f661445b57f0d20, entries=1, sequenceid=41, filesize=5.0 K 2023-11-11 04:53:38,278 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b5411216f3882b858e02206c99a35d9 in 45ms, sequenceid=41, compaction requested=true 2023-11-11 04:53:38,278 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:38,278 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:38,278 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:38,279 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:38,279 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,279 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 04:53:38,279 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 04:53:38,281 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,281 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:38,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:38,281 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,281 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:38,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:38,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:38,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:38,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 04:53:38,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cdc54ad[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:38,283 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 04:53:38,284 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,285 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,285 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 04:53:38,285 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 04:53:38,285 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:38,285 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,285 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:38,288 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,288 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 04:53:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:38,288 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:38,288 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 04:53:38,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:38,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:38,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:38,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:38,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 04:53:38,292 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 04:53:38,292 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:38,292 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:38,292 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,293 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:38,295 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,295 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:38,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:38,295 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:38,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,296 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,300 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,302 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,302 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:38,302 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:38,303 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:38,303 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,303 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:38,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 04:53:38,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:38,303 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:38,303 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:38,303 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,303 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,303 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:38,304 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:38,404 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:38,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:38,411 DEBUG [Listener at localhost/35271] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-11 04:53:38,414 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-11 04:53:38,415 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:38,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 04:53:38,430 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 04:53:38,431 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679018431 2023-11-11 04:53:38,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:53:38,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:53:38,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-11 04:53:38,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 04:53:38,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x11023a80 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:53:38,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ba5c93a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:53:38,445 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:39,324 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a8db726640a843f6a9a6b38e0dea6bf9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103a8db726640a843f6a9a6b38e0dea6bf9 2023-11-11 04:53:39,326 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 04:53:39,345 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:53:39,347 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:53:39,359 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:53:39,360 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:53:39,403 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e817d9f57c324bbbb795a14ff89c1b12 first=Optional[r3] last=Optional[r6] 2023-11-11 04:53:39,420 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e817d9f57c324bbbb795a14ff89c1b12}] 2023-11-11 04:53:39,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e817d9f57c324bbbb795a14ff89c1b12 for inclusion in 3b5411216f3882b858e02206c99a35d9/family1 2023-11-11 04:53:39,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-11 04:53:39,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:53:39,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:39,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e817d9f57c324bbbb795a14ff89c1b12 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tf0oc9tjo8tivektvb2s1jlav18bbsna0em7idf2f3g32rkbv71ol222god79jd/family1/e817d9f57c324bbbb795a14ff89c1b12 2023-11-11 04:53:39,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tf0oc9tjo8tivektvb2s1jlav18bbsna0em7idf2f3g32rkbv71ol222god79jd/family1/e817d9f57c324bbbb795a14ff89c1b12 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/d1ed8ce7a5214a019dc12ee5c75dcb7c_SeqId_44_ 2023-11-11 04:53:39,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tf0oc9tjo8tivektvb2s1jlav18bbsna0em7idf2f3g32rkbv71ol222god79jd/family1/e817d9f57c324bbbb795a14ff89c1b12 into 3b5411216f3882b858e02206c99a35d9/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/d1ed8ce7a5214a019dc12ee5c75dcb7c_SeqId_44_ - updating store file list. 2023-11-11 04:53:39,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/d1ed8ce7a5214a019dc12ee5c75dcb7c_SeqId_44_ into 3b5411216f3882b858e02206c99a35d9/family1 2023-11-11 04:53:39,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tf0oc9tjo8tivektvb2s1jlav18bbsna0em7idf2f3g32rkbv71ol222god79jd/family1/e817d9f57c324bbbb795a14ff89c1b12 into 3b5411216f3882b858e02206c99a35d9/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/d1ed8ce7a5214a019dc12ee5c75dcb7c_SeqId_44_) 2023-11-11 04:53:39,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tf0oc9tjo8tivektvb2s1jlav18bbsna0em7idf2f3g32rkbv71ol222god79jd/family1/e817d9f57c324bbbb795a14ff89c1b12 2023-11-11 04:53:39,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 04:53:39,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 04:53:39,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): 3b5411216f3882b858e02206c99a35d9/family1 is initiating minor compaction 2023-11-11 04:53:39,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1d122694; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:53:39,474 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3b5411216f3882b858e02206c99a35d9/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:39,475 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/eb3949d76481447a8956336ebb87f1dc, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/49a132007dd24316b5ad387245045710, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/f74694820f9b402c8a1f4001147e612e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/bd4c3f2cd9734cb99d7ecfa0fa97c7d0, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4986dd95b65143d88bed3a1b1511ab3b, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/61e4d099ed0e4cbfa2fa3766e7cb8499, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/24824ba3dfe04d14b44ab61cfb262cb4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/c1cdfd75f1e74ca3be7a20c3f1025aa0, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4e919bb7785946559f661445b57f0d20, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/d1ed8ce7a5214a019dc12ee5c75dcb7c_SeqId_44_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp, totalSize=50.2 K 2023-11-11 04:53:39,475 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting eb3949d76481447a8956336ebb87f1dc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 04:53:39,476 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 49a132007dd24316b5ad387245045710, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 04:53:39,476 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting f74694820f9b402c8a1f4001147e612e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 04:53:39,476 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting bd4c3f2cd9734cb99d7ecfa0fa97c7d0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 04:53:39,476 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 4986dd95b65143d88bed3a1b1511ab3b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 04:53:39,476 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 61e4d099ed0e4cbfa2fa3766e7cb8499, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 04:53:39,476 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 24824ba3dfe04d14b44ab61cfb262cb4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 04:53:39,476 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting c1cdfd75f1e74ca3be7a20c3f1025aa0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 04:53:39,476 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 4e919bb7785946559f661445b57f0d20, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 04:53:39,477 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting d1ed8ce7a5214a019dc12ee5c75dcb7c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 04:53:39,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 04:53:39,496 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:53:39,503 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228d47bacd61ab84181ade576d056a8bec2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228d47bacd61ab84181ade576d056a8bec2 2023-11-11 04:53:39,505 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231b60858b797d54a139ce81f9dccb3ba0d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231b60858b797d54a139ce81f9dccb3ba0d 2023-11-11 04:53:39,507 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015e895e0091d4477aa20a760ec153fbbd to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015e895e0091d4477aa20a760ec153fbbd 2023-11-11 04:53:39,509 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031925b524b5b44a8bb50882ca4a3537a7 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031925b524b5b44a8bb50882ca4a3537a7 2023-11-11 04:53:39,509 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-11 04:53:39,509 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-11 04:53:39,510 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:39,510 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:39,510 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:39,510 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:39,510 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:39,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:39,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:39,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:39,547 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3b5411216f3882b858e02206c99a35d9#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:53:40,374 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/73956b05f8cc460f9396476b449ba1b1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/73956b05f8cc460f9396476b449ba1b1 2023-11-11 04:53:40,390 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 3b5411216f3882b858e02206c99a35d9/family1 of 3b5411216f3882b858e02206c99a35d9 into 73956b05f8cc460f9396476b449ba1b1(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:53:40,390 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:40,392 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1699678419472; duration=0sec 2023-11-11 04:53:40,392 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:53:40,404 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a849b67e2f7447d6b876b4087363c228 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a849b67e2f7447d6b876b4087363c228 2023-11-11 04:53:40,406 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 04:53:40,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/eb3949d76481447a8956336ebb87f1dc, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/49a132007dd24316b5ad387245045710, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/f74694820f9b402c8a1f4001147e612e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/bd4c3f2cd9734cb99d7ecfa0fa97c7d0, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4986dd95b65143d88bed3a1b1511ab3b, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/61e4d099ed0e4cbfa2fa3766e7cb8499, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/24824ba3dfe04d14b44ab61cfb262cb4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/c1cdfd75f1e74ca3be7a20c3f1025aa0, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4e919bb7785946559f661445b57f0d20, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/d1ed8ce7a5214a019dc12ee5c75dcb7c_SeqId_44_] to archive 2023-11-11 04:53:40,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:53:40,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/eb3949d76481447a8956336ebb87f1dc to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/eb3949d76481447a8956336ebb87f1dc 2023-11-11 04:53:40,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/49a132007dd24316b5ad387245045710 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/49a132007dd24316b5ad387245045710 2023-11-11 04:53:40,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/f74694820f9b402c8a1f4001147e612e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/f74694820f9b402c8a1f4001147e612e 2023-11-11 04:53:40,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/bd4c3f2cd9734cb99d7ecfa0fa97c7d0 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/bd4c3f2cd9734cb99d7ecfa0fa97c7d0 2023-11-11 04:53:40,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4986dd95b65143d88bed3a1b1511ab3b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4986dd95b65143d88bed3a1b1511ab3b 2023-11-11 04:53:40,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/61e4d099ed0e4cbfa2fa3766e7cb8499 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/61e4d099ed0e4cbfa2fa3766e7cb8499 2023-11-11 04:53:40,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/24824ba3dfe04d14b44ab61cfb262cb4 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/24824ba3dfe04d14b44ab61cfb262cb4 2023-11-11 04:53:40,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/c1cdfd75f1e74ca3be7a20c3f1025aa0 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/c1cdfd75f1e74ca3be7a20c3f1025aa0 2023-11-11 04:53:40,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4e919bb7785946559f661445b57f0d20 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/4e919bb7785946559f661445b57f0d20 2023-11-11 04:53:40,446 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/d1ed8ce7a5214a019dc12ee5c75dcb7c_SeqId_44_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/d1ed8ce7a5214a019dc12ee5c75dcb7c_SeqId_44_ 2023-11-11 04:53:40,447 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92552ca77399407fbe726e70b3da5383 first=Optional[r00] last=Optional[r2] 2023-11-11 04:53:40,450 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92552ca77399407fbe726e70b3da5383}] 2023-11-11 04:53:40,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92552ca77399407fbe726e70b3da5383 for inclusion in 3b5411216f3882b858e02206c99a35d9/family1 2023-11-11 04:53:40,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-11 04:53:40,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:53:40,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:40,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92552ca77399407fbe726e70b3da5383 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gik4m9vgq69d5pjb5607udm3m9iqj53i224amuq0hrrbuumq33tf69bsl1djen4/family1/92552ca77399407fbe726e70b3da5383 2023-11-11 04:53:40,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gik4m9vgq69d5pjb5607udm3m9iqj53i224amuq0hrrbuumq33tf69bsl1djen4/family1/92552ca77399407fbe726e70b3da5383 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/ff5c11c65d3c416d9ceb09e6f79fa00c_SeqId_47_ 2023-11-11 04:53:40,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gik4m9vgq69d5pjb5607udm3m9iqj53i224amuq0hrrbuumq33tf69bsl1djen4/family1/92552ca77399407fbe726e70b3da5383 into 3b5411216f3882b858e02206c99a35d9/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/ff5c11c65d3c416d9ceb09e6f79fa00c_SeqId_47_ - updating store file list. 2023-11-11 04:53:40,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/ff5c11c65d3c416d9ceb09e6f79fa00c_SeqId_47_ into 3b5411216f3882b858e02206c99a35d9/family1 2023-11-11 04:53:40,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gik4m9vgq69d5pjb5607udm3m9iqj53i224amuq0hrrbuumq33tf69bsl1djen4/family1/92552ca77399407fbe726e70b3da5383 into 3b5411216f3882b858e02206c99a35d9/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/ff5c11c65d3c416d9ceb09e6f79fa00c_SeqId_47_) 2023-11-11 04:53:40,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gik4m9vgq69d5pjb5607udm3m9iqj53i224amuq0hrrbuumq33tf69bsl1djen4/family1/92552ca77399407fbe726e70b3da5383 2023-11-11 04:53:40,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 04:53:40,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 04:53:40,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): 3b5411216f3882b858e02206c99a35d9/family1 is initiating minor compaction (all files) 2023-11-11 04:53:40,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@53de2fb0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:53:40,472 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3b5411216f3882b858e02206c99a35d9/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:40,473 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/e8823053f98f432a9f1d4f009718aabc, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/73956b05f8cc460f9396476b449ba1b1, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/ff5c11c65d3c416d9ceb09e6f79fa00c_SeqId_47_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp, totalSize=358.6 K 2023-11-11 04:53:40,473 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting e8823053f98f432a9f1d4f009718aabc, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828286 2023-11-11 04:53:40,474 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 73956b05f8cc460f9396476b449ba1b1, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228286 2023-11-11 04:53:40,475 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting ff5c11c65d3c416d9ceb09e6f79fa00c_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878828286 2023-11-11 04:53:40,476 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 04:53:40,477 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:53:40,479 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130fc5b1d44b38a4658926d0694d39504d6 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130fc5b1d44b38a4658926d0694d39504d6 2023-11-11 04:53:40,481 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ceaeacd2a727460f880635c78270de4d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ceaeacd2a727460f880635c78270de4d 2023-11-11 04:53:40,483 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512053d3f33cd9f2d422997759059dd2262a5 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512053d3f33cd9f2d422997759059dd2262a5 2023-11-11 04:53:40,483 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-11 04:53:40,483 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-11 04:53:40,484 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:40,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 04:53:40,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:53:40,485 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 04:53:40,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0650 sec 2023-11-11 04:53:40,520 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3b5411216f3882b858e02206c99a35d9#family1#compaction#11 average throughput is 5.90 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:53:40,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-11 04:53:40,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:40,731 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-11 04:53:40,733 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-11 04:53:40,733 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-11 04:53:40,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-11 04:53:40,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3b5411216f3882b858e02206c99a35d9, REOPEN/MOVE}] 2023-11-11 04:53:40,757 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3b5411216f3882b858e02206c99a35d9, REOPEN/MOVE 2023-11-11 04:53:40,758 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3b5411216f3882b858e02206c99a35d9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:40,758 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699678420758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678420758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678420758"}]},"ts":"1699678420758"} 2023-11-11 04:53:40,759 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38667] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=CLOSING, location=jenkins-hbase4.apache.org,43941,1699678403879, table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3b5411216f3882b858e02206c99a35d9. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-11-11 04:53:40,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 3b5411216f3882b858e02206c99a35d9, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:53:40,921 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:40,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:40,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3b5411216f3882b858e02206c99a35d9, disabling compactions & flushes 2023-11-11 04:53:40,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:41,776 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/.tmp/family1/47577e29f791465fa98780f80339cecf as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/47577e29f791465fa98780f80339cecf 2023-11-11 04:53:41,784 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 3b5411216f3882b858e02206c99a35d9/family1 of 3b5411216f3882b858e02206c99a35d9 into 47577e29f791465fa98780f80339cecf(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:53:41,784 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:41,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:41,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:41,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. after waiting 0 ms 2023-11-11 04:53:41,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:41,785 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1699678420471; duration=1sec 2023-11-11 04:53:41,785 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:53:41,788 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/e8823053f98f432a9f1d4f009718aabc, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/73956b05f8cc460f9396476b449ba1b1, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/ff5c11c65d3c416d9ceb09e6f79fa00c_SeqId_47_] to archive 2023-11-11 04:53:41,789 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:53:41,791 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/e8823053f98f432a9f1d4f009718aabc to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/e8823053f98f432a9f1d4f009718aabc 2023-11-11 04:53:41,792 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/73956b05f8cc460f9396476b449ba1b1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/73956b05f8cc460f9396476b449ba1b1 2023-11-11 04:53:41,794 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/ff5c11c65d3c416d9ceb09e6f79fa00c_SeqId_47_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/ff5c11c65d3c416d9ceb09e6f79fa00c_SeqId_47_ 2023-11-11 04:53:41,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-11 04:53:41,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:41,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:41,801 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 3b5411216f3882b858e02206c99a35d9 to self. 2023-11-11 04:53:41,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:41,804 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3b5411216f3882b858e02206c99a35d9, regionState=CLOSED 2023-11-11 04:53:41,804 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699678421804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678421804"}]},"ts":"1699678421804"} 2023-11-11 04:53:41,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-11 04:53:41,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 3b5411216f3882b858e02206c99a35d9, server=jenkins-hbase4.apache.org,43941,1699678403879 in 1.0450 sec 2023-11-11 04:53:41,809 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3b5411216f3882b858e02206c99a35d9, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=true 2023-11-11 04:53:41,960 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3b5411216f3882b858e02206c99a35d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:41,960 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699678421960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678421960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678421960"}]},"ts":"1699678421960"} 2023-11-11 04:53:41,962 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 3b5411216f3882b858e02206c99a35d9, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:53:42,115 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:42,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:42,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3b5411216f3882b858e02206c99a35d9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:53:42,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:42,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:42,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:42,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:42,121 INFO [StoreOpener-3b5411216f3882b858e02206c99a35d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:42,123 DEBUG [StoreOpener-3b5411216f3882b858e02206c99a35d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1 2023-11-11 04:53:42,123 DEBUG [StoreOpener-3b5411216f3882b858e02206c99a35d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1 2023-11-11 04:53:42,123 INFO [StoreOpener-3b5411216f3882b858e02206c99a35d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b5411216f3882b858e02206c99a35d9 columnFamilyName family1 2023-11-11 04:53:42,131 DEBUG [StoreOpener-3b5411216f3882b858e02206c99a35d9-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/47577e29f791465fa98780f80339cecf 2023-11-11 04:53:42,131 INFO [StoreOpener-3b5411216f3882b858e02206c99a35d9-1] regionserver.HStore(310): Store=3b5411216f3882b858e02206c99a35d9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:42,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:42,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:42,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:53:42,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3b5411216f3882b858e02206c99a35d9; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63046167, jitterRate=-0.06053890287876129}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:53:42,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:42,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9., pid=17, masterSystemTime=1699678422115 2023-11-11 04:53:42,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:42,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:53:42,142 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3b5411216f3882b858e02206c99a35d9, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:42,142 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699678422141"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678422141"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678422141"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678422141"}]},"ts":"1699678422141"} 2023-11-11 04:53:42,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-11 04:53:42,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 3b5411216f3882b858e02206c99a35d9, server=jenkins-hbase4.apache.org,43941,1699678403879 in 182 msec 2023-11-11 04:53:42,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-11 04:53:42,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3b5411216f3882b858e02206c99a35d9, REOPEN/MOVE in 1.3910 sec 2023-11-11 04:53:42,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-11 04:53:42,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4120 sec 2023-11-11 04:53:42,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4450 sec 2023-11-11 04:53:42,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-11 04:53:42,164 INFO [Listener at localhost/35271] compactions.TestMobCompactor(278): alter status finished 2023-11-11 04:53:42,165 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 04:53:42,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 04:53:42,168 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 04:53:42,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:53:42,169 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679022169 2023-11-11 04:53:42,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:53:42,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-11 04:53:42,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 04:53:42,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x09b8349a to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:53:42,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27818f65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:53:42,178 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:42,178 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:42,178 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:42,178 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:42,178 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:42,644 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:53:42,644 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11023a80 to 127.0.0.1:61842 2023-11-11 04:53:42,644 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:53:42,657 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128716684ae447b4d129ba3f08b8bd5fe63 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128716684ae447b4d129ba3f08b8bd5fe63 2023-11-11 04:53:42,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 04:53:42,672 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:53:42,673 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:53:42,680 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:53:42,682 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:53:42,692 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a861c3796d9456d9dd7479b4aa4bc58 first=Optional[r05] last=Optional[r8] 2023-11-11 04:53:42,693 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=51 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a861c3796d9456d9dd7479b4aa4bc58}] 2023-11-11 04:53:42,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a861c3796d9456d9dd7479b4aa4bc58 for inclusion in 3b5411216f3882b858e02206c99a35d9/family1 2023-11-11 04:53:42,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-11 04:53:42,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:53:42,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:53:42,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a861c3796d9456d9dd7479b4aa4bc58 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ddbf5da55etumhr0b4p3h4cjp295h6lh5761a6d463env88e80c17v08qkr2aiqe/family1/4a861c3796d9456d9dd7479b4aa4bc58 2023-11-11 04:53:42,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ddbf5da55etumhr0b4p3h4cjp295h6lh5761a6d463env88e80c17v08qkr2aiqe/family1/4a861c3796d9456d9dd7479b4aa4bc58 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/b507e1b1e91946128cfe7689a9af5c61_SeqId_53_ 2023-11-11 04:53:42,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ddbf5da55etumhr0b4p3h4cjp295h6lh5761a6d463env88e80c17v08qkr2aiqe/family1/4a861c3796d9456d9dd7479b4aa4bc58 into 3b5411216f3882b858e02206c99a35d9/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/b507e1b1e91946128cfe7689a9af5c61_SeqId_53_ - updating store file list. 2023-11-11 04:53:42,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/b507e1b1e91946128cfe7689a9af5c61_SeqId_53_ into 3b5411216f3882b858e02206c99a35d9/family1 2023-11-11 04:53:42,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ddbf5da55etumhr0b4p3h4cjp295h6lh5761a6d463env88e80c17v08qkr2aiqe/family1/4a861c3796d9456d9dd7479b4aa4bc58 into 3b5411216f3882b858e02206c99a35d9/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/family1/b507e1b1e91946128cfe7689a9af5c61_SeqId_53_) 2023-11-11 04:53:42,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ddbf5da55etumhr0b4p3h4cjp295h6lh5761a6d463env88e80c17v08qkr2aiqe/family1/4a861c3796d9456d9dd7479b4aa4bc58 2023-11-11 04:53:42,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 04:53:42,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:53:42,718 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112062a4bc9450b04517b69cec1c5c2e68c1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112062a4bc9450b04517b69cec1c5c2e68c1 2023-11-11 04:53:42,719 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511288e7caf115a124e60b987deef972ec215 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511288e7caf115a124e60b987deef972ec215 2023-11-11 04:53:42,719 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-11 04:53:42,719 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-11 04:53:42,719 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:42,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:42,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 04:53:42,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 04:53:42,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:53:42,720 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 04:53:42,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 555 msec 2023-11-11 04:53:42,805 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=248 (was 214) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56238 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:55960 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56248 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61842@0x09b8349a-SendThread(127.0.0.1:61842) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56080 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56182 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56088 [Waiting for operation #27] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/cluster_4ad29b40-445f-1468-05dc-b255cb81bdb5/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:43941-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/cluster_4ad29b40-445f-1468-05dc-b255cb81bdb5/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56152 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-192606000_17 at /127.0.0.1:56206 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56068 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61842@0x09b8349a sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/2013315585.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7583d9ae-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56034 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56102 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56054 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7583d9ae-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56000 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56170 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56040 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56130 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7583d9ae-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61842@0x09b8349a-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) - Thread LEAK? -, OpenFileDescriptor=614 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=276 (was 296), ProcessCount=169 (was 169), AvailableMemoryMB=2293 (was 2704) 2023-11-11 04:53:42,822 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=614, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=169, AvailableMemoryMB=2292 2023-11-11 04:53:42,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-11 04:53:42,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:42,827 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:53:42,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-11 04:53:42,828 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:53:42,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 04:53:42,830 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6 2023-11-11 04:53:42,831 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6 empty. 2023-11-11 04:53:42,831 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6 2023-11-11 04:53:42,831 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-11 04:53:42,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 04:53:43,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 04:53:43,243 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-11 04:53:43,244 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 76461f05efc482fa7730ea065191b0d6, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:53:43,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 04:53:43,651 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:43,652 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 76461f05efc482fa7730ea065191b0d6, disabling compactions & flushes 2023-11-11 04:53:43,652 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:43,652 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:43,652 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. after waiting 0 ms 2023-11-11 04:53:43,652 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:43,652 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:43,652 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:43,655 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:53:43,656 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699678423656"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678423656"}]},"ts":"1699678423656"} 2023-11-11 04:53:43,658 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 04:53:43,659 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:53:43,659 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678423659"}]},"ts":"1699678423659"} 2023-11-11 04:53:43,660 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-11 04:53:43,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=76461f05efc482fa7730ea065191b0d6, ASSIGN}] 2023-11-11 04:53:43,666 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=76461f05efc482fa7730ea065191b0d6, ASSIGN 2023-11-11 04:53:43,667 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=76461f05efc482fa7730ea065191b0d6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:53:43,818 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=76461f05efc482fa7730ea065191b0d6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:43,818 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699678423818"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678423818"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678423818"}]},"ts":"1699678423818"} 2023-11-11 04:53:43,820 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 76461f05efc482fa7730ea065191b0d6, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:53:43,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 04:53:43,972 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:43,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:43,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 76461f05efc482fa7730ea065191b0d6, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:53:43,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 76461f05efc482fa7730ea065191b0d6 2023-11-11 04:53:43,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:43,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 76461f05efc482fa7730ea065191b0d6 2023-11-11 04:53:43,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 76461f05efc482fa7730ea065191b0d6 2023-11-11 04:53:43,981 INFO [StoreOpener-76461f05efc482fa7730ea065191b0d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 76461f05efc482fa7730ea065191b0d6 2023-11-11 04:53:43,983 DEBUG [StoreOpener-76461f05efc482fa7730ea065191b0d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1 2023-11-11 04:53:43,983 DEBUG [StoreOpener-76461f05efc482fa7730ea065191b0d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1 2023-11-11 04:53:43,984 INFO [StoreOpener-76461f05efc482fa7730ea065191b0d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76461f05efc482fa7730ea065191b0d6 columnFamilyName family1 2023-11-11 04:53:43,986 INFO [StoreOpener-76461f05efc482fa7730ea065191b0d6-1] regionserver.HStore(310): Store=76461f05efc482fa7730ea065191b0d6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:43,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6 2023-11-11 04:53:43,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6 2023-11-11 04:53:43,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 76461f05efc482fa7730ea065191b0d6 2023-11-11 04:53:43,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:53:43,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 76461f05efc482fa7730ea065191b0d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68955927, jitterRate=0.027523383498191833}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:53:43,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:43,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6., pid=21, masterSystemTime=1699678423972 2023-11-11 04:53:44,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:44,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:44,002 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=76461f05efc482fa7730ea065191b0d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:44,002 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699678424002"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678424002"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678424002"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678424002"}]},"ts":"1699678424002"} 2023-11-11 04:53:44,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-11 04:53:44,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 76461f05efc482fa7730ea065191b0d6, server=jenkins-hbase4.apache.org,43941,1699678403879 in 184 msec 2023-11-11 04:53:44,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-11 04:53:44,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=76461f05efc482fa7730ea065191b0d6, ASSIGN in 343 msec 2023-11-11 04:53:44,010 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:53:44,011 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678424010"}]},"ts":"1699678424010"} 2023-11-11 04:53:44,012 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-11 04:53:44,015 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:53:44,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1910 sec 2023-11-11 04:53:44,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 04:53:44,935 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-11 04:53:44,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:44,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:44,973 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:44,973 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:44,974 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:53:44,974 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:44,974 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:44,974 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:45,088 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:45,088 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:45,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:45,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:45,089 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:45,089 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:45,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:45,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:45,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:45,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:45,090 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:53:45,090 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:53:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:45,091 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:45,091 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. started... 2023-11-11 04:53:45,092 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 76461f05efc482fa7730ea065191b0d6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 04:53:45,519 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307a408a5f9e564d0da7426663d07a6e9e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511307a408a5f9e564d0da7426663d07a6e9e 2023-11-11 04:53:45,923 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/9b2103d9be65427fa0cdba761ec0103c 2023-11-11 04:53:45,930 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/9b2103d9be65427fa0cdba761ec0103c as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9b2103d9be65427fa0cdba761ec0103c 2023-11-11 04:53:45,936 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9b2103d9be65427fa0cdba761ec0103c, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-11 04:53:45,937 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 76461f05efc482fa7730ea065191b0d6 in 845ms, sequenceid=5, compaction requested=false 2023-11-11 04:53:45,938 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:45,938 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:45,938 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:45,938 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:45,939 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:45,939 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:45,939 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:53:45,939 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:53:45,996 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:45,996 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:45,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:45,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:45,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:45,996 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:45,996 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:45,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:45,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:53:45,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43293951[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:45,998 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:53:45,998 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,042 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,042 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:53:46,042 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:53:46,042 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:46,042 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,042 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:46,111 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,111 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:53:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:46,111 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:46,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:46,112 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:53:46,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:46,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:46,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:46,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:53:46,115 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:53:46,115 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:46,115 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:46,115 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,115 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:46,188 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,188 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:46,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,188 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:46,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:46,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:46,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:46,189 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:46,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:46,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,190 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:46,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,336 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,336 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:46,336 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:46,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:46,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:46,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:46,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 04:53:46,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:46,337 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,337 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:46,338 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:46,337 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,338 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:46,338 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:46,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:46,338 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,338 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,438 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:46,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:46,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:46,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:46,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,445 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:46,445 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:46,446 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:53:46,446 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:46,446 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,447 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,511 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,511 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:46,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:46,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:46,511 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:46,511 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:46,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:46,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,513 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,513 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:53:46,513 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:46,513 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:53:46,513 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:46,514 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:53:46,514 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:46,514 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:46,514 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:46,514 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. started... 2023-11-11 04:53:46,514 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 76461f05efc482fa7730ea065191b0d6 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 04:53:46,929 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283886e4d40059476c9ea8c376be769fd4 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511283886e4d40059476c9ea8c376be769fd4 2023-11-11 04:53:47,336 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/9d29d4515e6746c68c0aab72383f8698 2023-11-11 04:53:47,340 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:53:47,342 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/9d29d4515e6746c68c0aab72383f8698 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9d29d4515e6746c68c0aab72383f8698 2023-11-11 04:53:47,348 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9d29d4515e6746c68c0aab72383f8698, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 04:53:47,349 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 76461f05efc482fa7730ea065191b0d6 in 835ms, sequenceid=9, compaction requested=false 2023-11-11 04:53:47,350 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:47,350 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:47,350 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:47,350 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:47,350 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,350 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:53:47,350 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:53:47,352 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,352 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:47,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:47,352 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,352 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:47,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:47,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:47,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:47,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:53:47,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a27dfb5[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:47,354 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:53:47,354 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,355 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,356 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:53:47,356 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,356 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:47,356 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:53:47,356 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:47,358 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,358 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:53:47,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:47,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:47,358 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:47,358 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:53:47,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:47,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:47,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:47,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:47,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:53:47,363 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:53:47,363 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:47,363 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:47,363 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,363 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:47,365 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,365 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:47,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:47,365 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:47,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:47,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:47,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:47,366 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:47,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,368 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:47,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,371 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,371 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,371 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:47,371 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:47,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:47,372 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:47,372 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:47,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:47,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:47,372 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,372 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,373 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,373 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:47,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:47,373 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:47,373 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:47,473 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:47,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:47,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:47,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:47,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,482 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:47,482 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:47,483 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:53:47,483 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:47,483 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,483 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,485 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:47,485 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:47,486 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,486 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:47,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,487 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,487 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:53:47,487 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,487 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:53:47,487 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:47,488 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:53:47,488 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:47,488 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:47,488 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:47,488 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. started... 2023-11-11 04:53:47,488 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 76461f05efc482fa7730ea065191b0d6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:47,524 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018f056c15825d472599cd6f0879911270 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018f056c15825d472599cd6f0879911270 2023-11-11 04:53:47,931 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/b583ee4fbaab49c9b504f1e8a7cd29cf 2023-11-11 04:53:47,938 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/b583ee4fbaab49c9b504f1e8a7cd29cf as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b583ee4fbaab49c9b504f1e8a7cd29cf 2023-11-11 04:53:47,943 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b583ee4fbaab49c9b504f1e8a7cd29cf, entries=1, sequenceid=13, filesize=4.9 K 2023-11-11 04:53:47,944 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 76461f05efc482fa7730ea065191b0d6 in 456ms, sequenceid=13, compaction requested=true 2023-11-11 04:53:47,944 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:47,944 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:47,944 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:47,944 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:47,944 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,944 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:53:47,944 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:53:47,946 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,946 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:47,946 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,946 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:47,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:47,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:47,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:53:47,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54b7e84[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:47,948 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:53:47,948 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,949 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,950 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:53:47,950 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:53:47,950 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:47,950 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,950 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:47,952 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:53:47,952 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,952 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:47,952 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:53:47,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:47,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:47,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:47,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:47,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:47,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:47,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:53:47,956 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:53:47,956 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:47,956 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:47,956 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,956 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:47,957 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,957 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:47,957 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:47,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:47,958 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,960 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:47,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:47,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:47,963 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:47,964 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:47,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:47,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:47,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,964 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:47,964 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:47,964 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:47,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:47,964 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:47,964 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:47,964 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,064 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:48,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:48,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:48,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:48,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,072 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:48,072 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:48,073 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:53:48,073 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:48,073 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,074 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,075 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,075 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:48,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:48,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:48,075 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,075 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:48,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:48,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,076 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,076 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:53:48,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,076 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:53:48,076 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:48,077 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:53:48,077 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:48,077 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:48,077 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:48,077 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. started... 2023-11-11 04:53:48,077 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 76461f05efc482fa7730ea065191b0d6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:48,493 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205892764e262ed45b08fd7078e06a6c04a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205892764e262ed45b08fd7078e06a6c04a 2023-11-11 04:53:48,900 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/762de4abb66047009a573124ecef8ca4 2023-11-11 04:53:48,906 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/762de4abb66047009a573124ecef8ca4 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/762de4abb66047009a573124ecef8ca4 2023-11-11 04:53:48,911 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/762de4abb66047009a573124ecef8ca4, entries=1, sequenceid=17, filesize=4.9 K 2023-11-11 04:53:48,913 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 76461f05efc482fa7730ea065191b0d6 in 835ms, sequenceid=17, compaction requested=true 2023-11-11 04:53:48,913 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:48,913 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:48,913 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:48,913 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:48,913 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,913 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:53:48,913 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:53:48,916 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:48,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:53:48,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b2c3bbc[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:48,918 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:53:48,918 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,919 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,919 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:53:48,919 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:53:48,920 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:48,920 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,920 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:53:48,924 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:53:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:48,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:48,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:53:48,927 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:53:48,927 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:48,927 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:48,927 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,927 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:48,930 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,930 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:48,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,930 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:48,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:48,931 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,933 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,935 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,935 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,935 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:48,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:48,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:48,936 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:48,937 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:48,937 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:48,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:49,037 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:49,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:49,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:49,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:49,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,046 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:49,046 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:49,046 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:53:49,046 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:49,047 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,047 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,049 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:49,049 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:49,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:49,049 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,049 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:49,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:49,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,050 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,051 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:53:49,051 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,051 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:53:49,051 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:49,051 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:53:49,052 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:49,052 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:49,052 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:49,052 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. started... 2023-11-11 04:53:49,052 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 76461f05efc482fa7730ea065191b0d6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:49,470 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122808dc34175fa7480e8bcdbe5f771fba8b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122808dc34175fa7480e8bcdbe5f771fba8b 2023-11-11 04:53:49,880 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/d7a2639dfc204a63a85dc8a0af5d15bd 2023-11-11 04:53:49,886 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/d7a2639dfc204a63a85dc8a0af5d15bd as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/d7a2639dfc204a63a85dc8a0af5d15bd 2023-11-11 04:53:49,891 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/d7a2639dfc204a63a85dc8a0af5d15bd, entries=1, sequenceid=21, filesize=4.9 K 2023-11-11 04:53:49,892 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 76461f05efc482fa7730ea065191b0d6 in 840ms, sequenceid=21, compaction requested=true 2023-11-11 04:53:49,892 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:49,892 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:49,892 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:49,893 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:49,893 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,893 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:53:49,893 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:53:49,895 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,895 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:49,895 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,895 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:49,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:53:49,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11c56a39[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:49,897 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:53:49,897 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,898 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,898 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:53:49,898 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:53:49,898 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:49,898 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,899 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:49,901 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:53:49,901 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,901 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:49,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:49,901 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:53:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:49,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:53:49,904 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:53:49,905 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:49,905 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:49,905 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,905 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:49,906 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,906 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:49,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,906 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:49,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:49,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:49,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:49,907 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:49,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,908 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,911 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:49,911 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,911 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,912 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,912 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:49,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:49,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:49,912 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:49,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:49,912 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 04:53:49,912 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:49,912 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,913 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:49,913 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:49,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:49,913 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:50,013 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:50,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:50,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:50,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:50,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,022 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:50,022 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:50,022 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:53:50,022 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:50,023 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,023 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,024 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,024 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:50,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:50,025 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,025 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,026 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,026 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:53:50,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:53:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:50,027 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:53:50,027 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:50,027 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:50,027 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:50,027 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. started... 2023-11-11 04:53:50,027 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 76461f05efc482fa7730ea065191b0d6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:50,444 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231346f7c53a7ff45ec934fbbb7224dd575 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231346f7c53a7ff45ec934fbbb7224dd575 2023-11-11 04:53:50,454 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/b8d98e742e2b41adac9c1c704cc5bc56 2023-11-11 04:53:50,465 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/b8d98e742e2b41adac9c1c704cc5bc56 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b8d98e742e2b41adac9c1c704cc5bc56 2023-11-11 04:53:50,472 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b8d98e742e2b41adac9c1c704cc5bc56, entries=1, sequenceid=25, filesize=4.9 K 2023-11-11 04:53:50,474 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 76461f05efc482fa7730ea065191b0d6 in 447ms, sequenceid=25, compaction requested=true 2023-11-11 04:53:50,474 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:50,474 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:50,474 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:50,474 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:50,474 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,474 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:53:50,474 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:53:50,476 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,476 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:50,477 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,477 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:50,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:50,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:50,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:50,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:53:50,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45cbc5c3[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:50,480 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:53:50,480 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,482 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:53:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:53:50,482 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:50,482 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,482 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:50,485 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:53:50,485 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:50,485 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,485 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:53:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:50,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:53:50,489 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:53:50,489 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:50,489 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:50,489 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,489 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:50,491 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,491 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:50,491 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,492 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:50,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,493 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:50,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:50,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:50,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:50,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:50,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,498 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,498 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,498 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,498 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:50,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 04:53:50,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:50,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:50,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:50,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:50,499 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:50,499 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:50,599 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:50,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:50,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:50,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:50,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,607 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:50,607 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:50,608 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:53:50,608 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:50,609 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,609 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,610 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,610 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:50,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:50,610 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:50,610 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,611 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,612 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:53:50,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:50,612 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:53:50,612 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:50,612 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:53:50,612 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:50,612 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:50,612 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:50,613 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. started... 2023-11-11 04:53:50,613 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 76461f05efc482fa7730ea065191b0d6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:51,034 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d82b2387c2744b02a9cb15d5287c1fae to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101d82b2387c2744b02a9cb15d5287c1fae 2023-11-11 04:53:51,440 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/9529236f07144d1490473077cdb9b338 2023-11-11 04:53:51,446 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/9529236f07144d1490473077cdb9b338 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9529236f07144d1490473077cdb9b338 2023-11-11 04:53:51,452 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9529236f07144d1490473077cdb9b338, entries=1, sequenceid=29, filesize=4.9 K 2023-11-11 04:53:51,453 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 76461f05efc482fa7730ea065191b0d6 in 840ms, sequenceid=29, compaction requested=true 2023-11-11 04:53:51,453 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:51,453 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:51,453 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:51,453 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:51,453 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,453 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:53:51,453 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:53:51,458 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,458 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:51,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:51,458 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,458 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:51,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:51,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:53:51,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b2a3ca0[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:51,460 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:53:51,460 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,461 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,462 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:53:51,462 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:53:51,462 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:51,462 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,462 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:51,463 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:53:51,463 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:51,463 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,463 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:53:51,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:51,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:51,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:51,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:51,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:51,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:53:51,467 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:53:51,467 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:51,467 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:51,467 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,467 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:51,470 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,470 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,470 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:51,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:51,471 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,472 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,475 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:51,475 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:51,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:51,475 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:51,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:51,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:51,475 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:51,475 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,475 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:51,476 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,476 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:51,476 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:51,476 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,476 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,476 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,576 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:51,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:51,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:51,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:51,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,586 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:51,586 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:51,587 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:53:51,587 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:51,587 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,587 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,588 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,588 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:51,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:51,589 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:51,589 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,590 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,590 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:53:51,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:51,590 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:53:51,590 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:51,591 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:53:51,591 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:51,591 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:51,591 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:51,591 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. started... 2023-11-11 04:53:51,591 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 76461f05efc482fa7730ea065191b0d6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:52,009 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b895730ed5ee49989a7e2db28c1113ce to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b895730ed5ee49989a7e2db28c1113ce 2023-11-11 04:53:52,415 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/8e73f1dee66a4a3d820d8fd4ef6f8de7 2023-11-11 04:53:52,421 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/8e73f1dee66a4a3d820d8fd4ef6f8de7 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/8e73f1dee66a4a3d820d8fd4ef6f8de7 2023-11-11 04:53:52,426 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/8e73f1dee66a4a3d820d8fd4ef6f8de7, entries=1, sequenceid=33, filesize=4.9 K 2023-11-11 04:53:52,427 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 76461f05efc482fa7730ea065191b0d6 in 836ms, sequenceid=33, compaction requested=true 2023-11-11 04:53:52,427 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:52,427 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,428 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:53:52,428 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:53:52,430 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,430 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:52,430 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,430 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:52,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:53:52,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61a105a2[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:52,432 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:53:52,432 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,433 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,433 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:53:52,433 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:53:52,433 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,433 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:52,433 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:52,434 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:53:52,434 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:52,434 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,434 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:53:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:52,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:52,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:53:52,437 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:53:52,437 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:52,437 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:52,437 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,437 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:52,440 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,440 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,440 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:52,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:52,441 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:52,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,442 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:52,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,445 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,445 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,445 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:52,445 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:52,445 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:52,445 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:52,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:52,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:52,446 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:52,445 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,446 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,446 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,446 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:52,446 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:52,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:52,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:52,547 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:52,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:52,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:52,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:52,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,555 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:52,555 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:52,555 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:53:52,555 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:52,555 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,556 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,557 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,557 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:52,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:52,557 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:52,557 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,558 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,558 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:53:52,558 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:52,558 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:53:52,559 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:52,559 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:53:52,559 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:52,559 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:52,559 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:52,559 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. started... 2023-11-11 04:53:52,559 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 76461f05efc482fa7730ea065191b0d6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:52,978 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078007160743db43f1bd78debb359074b5 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509078007160743db43f1bd78debb359074b5 2023-11-11 04:53:53,384 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/011587db1511416ebe63ddd5bce9d885 2023-11-11 04:53:53,391 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/011587db1511416ebe63ddd5bce9d885 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/011587db1511416ebe63ddd5bce9d885 2023-11-11 04:53:53,398 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/011587db1511416ebe63ddd5bce9d885, entries=1, sequenceid=37, filesize=4.9 K 2023-11-11 04:53:53,399 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 76461f05efc482fa7730ea065191b0d6 in 840ms, sequenceid=37, compaction requested=true 2023-11-11 04:53:53,399 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:53,399 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:53,399 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:53,399 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:53,399 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,399 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:53:53,399 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:53:53,401 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,401 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:53,402 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:53,402 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:53,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:53:53,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b0f2f0d[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:53,404 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:53:53,404 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,405 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,405 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:53:53,405 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:53:53,405 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:53,405 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,405 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:53,408 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,408 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:53:53,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,408 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:53,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:53,408 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:53:53,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:53,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:53,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:53,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:53:53,412 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:53:53,412 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:53,412 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:53,412 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,412 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:53,413 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,413 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:53,414 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:53,414 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:53,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:53,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,415 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:53,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,421 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,421 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:53,421 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:53,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:53,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:53,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:53,421 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:53,421 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:53,421 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,422 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:53,422 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:53,422 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,422 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:53,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:53,422 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,422 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,522 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:53,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:53,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:53,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:53,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,530 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:53,530 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:53,531 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:53:53,531 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:53,531 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,531 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,533 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:53,533 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:53,533 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,533 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:53,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,534 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,534 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:53:53,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,534 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:53:53,534 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:53,536 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:53:53,536 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:53,536 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:53,536 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:53,536 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. started... 2023-11-11 04:53:53,536 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 76461f05efc482fa7730ea065191b0d6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:53:53,550 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120242c4be6f03c483f8f573397a9b0bade to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120242c4be6f03c483f8f573397a9b0bade 2023-11-11 04:53:53,556 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/7b2c50ebeae74fa78a3f6224a6540d56 2023-11-11 04:53:53,561 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/7b2c50ebeae74fa78a3f6224a6540d56 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/7b2c50ebeae74fa78a3f6224a6540d56 2023-11-11 04:53:53,567 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/7b2c50ebeae74fa78a3f6224a6540d56, entries=1, sequenceid=41, filesize=4.9 K 2023-11-11 04:53:53,568 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 76461f05efc482fa7730ea065191b0d6 in 31ms, sequenceid=41, compaction requested=true 2023-11-11 04:53:53,568 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:53,568 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:53,568 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:53,568 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:53,568 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,568 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:53:53,568 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:53:53,570 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,570 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:53,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:53,570 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,570 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:53,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:53,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:53,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:53,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:53:53,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40710c72[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:53,572 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:53:53,572 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,573 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,573 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:53:53,574 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,574 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:53,574 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:53:53,574 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:53,576 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,576 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:53:53,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:53,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:53,576 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:53,577 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:53:53,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:53,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:53,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:53,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:53,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:53:53,580 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:53:53,580 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:53,580 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:53,580 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,580 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:53,581 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,582 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:53,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:53,582 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:53,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:53,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:53,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:53,582 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,584 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:53,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,586 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,586 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,586 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:53,586 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:53,586 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:53,586 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:53,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 04:53:53,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:53,586 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,586 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:53,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:53,587 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,588 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,588 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:53,588 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:53,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:53,688 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:53,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:53,691 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-11 04:53:53,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:53:53,693 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:53:53,694 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679033694 2023-11-11 04:53:53,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:53:53,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:53:53,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-11 04:53:53,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:53:53,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x21fe50d5 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:53:53,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a2f1928, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:53:53,702 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:53:54,540 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034ebb93ff49cf492ebf823c21342ffe75 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601034ebb93ff49cf492ebf823c21342ffe75 2023-11-11 04:53:54,541 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:53:54,554 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:53:54,556 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:53:54,562 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:53:54,563 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:53:54,572 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4148aa23696f4d6384be9d7ac00aead8 first=Optional[r5] last=Optional[r6] 2023-11-11 04:53:54,572 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4148aa23696f4d6384be9d7ac00aead8}] 2023-11-11 04:53:54,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4148aa23696f4d6384be9d7ac00aead8 for inclusion in 76461f05efc482fa7730ea065191b0d6/family1 2023-11-11 04:53:54,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-11 04:53:54,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:53:54,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:54,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4148aa23696f4d6384be9d7ac00aead8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nof6sddo44lnjv5r15hi9qeg592e1idr7s2ln693ffb01b71fl92k43db2tq7k9p/family1/4148aa23696f4d6384be9d7ac00aead8 2023-11-11 04:53:54,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nof6sddo44lnjv5r15hi9qeg592e1idr7s2ln693ffb01b71fl92k43db2tq7k9p/family1/4148aa23696f4d6384be9d7ac00aead8 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/bda5d2cee820458e9fc286351df0d686_SeqId_44_ 2023-11-11 04:53:54,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nof6sddo44lnjv5r15hi9qeg592e1idr7s2ln693ffb01b71fl92k43db2tq7k9p/family1/4148aa23696f4d6384be9d7ac00aead8 into 76461f05efc482fa7730ea065191b0d6/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/bda5d2cee820458e9fc286351df0d686_SeqId_44_ - updating store file list. 2023-11-11 04:53:54,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/bda5d2cee820458e9fc286351df0d686_SeqId_44_ into 76461f05efc482fa7730ea065191b0d6/family1 2023-11-11 04:53:54,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nof6sddo44lnjv5r15hi9qeg592e1idr7s2ln693ffb01b71fl92k43db2tq7k9p/family1/4148aa23696f4d6384be9d7ac00aead8 into 76461f05efc482fa7730ea065191b0d6/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/bda5d2cee820458e9fc286351df0d686_SeqId_44_) 2023-11-11 04:53:54,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nof6sddo44lnjv5r15hi9qeg592e1idr7s2ln693ffb01b71fl92k43db2tq7k9p/family1/4148aa23696f4d6384be9d7ac00aead8 2023-11-11 04:53:54,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 04:53:54,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 04:53:54,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): 76461f05efc482fa7730ea065191b0d6/family1 is initiating minor compaction 2023-11-11 04:53:54,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7b10295b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:53:54,593 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 76461f05efc482fa7730ea065191b0d6/family1 in testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:54,593 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9d29d4515e6746c68c0aab72383f8698, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b583ee4fbaab49c9b504f1e8a7cd29cf, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/762de4abb66047009a573124ecef8ca4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/d7a2639dfc204a63a85dc8a0af5d15bd, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b8d98e742e2b41adac9c1c704cc5bc56, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9529236f07144d1490473077cdb9b338, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/8e73f1dee66a4a3d820d8fd4ef6f8de7, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/011587db1511416ebe63ddd5bce9d885, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/7b2c50ebeae74fa78a3f6224a6540d56, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/bda5d2cee820458e9fc286351df0d686_SeqId_44_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp, totalSize=49.7 K 2023-11-11 04:53:54,593 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 9d29d4515e6746c68c0aab72383f8698, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 04:53:54,594 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting b583ee4fbaab49c9b504f1e8a7cd29cf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 04:53:54,594 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 762de4abb66047009a573124ecef8ca4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 04:53:54,594 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting d7a2639dfc204a63a85dc8a0af5d15bd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 04:53:54,594 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting b8d98e742e2b41adac9c1c704cc5bc56, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 04:53:54,594 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 9529236f07144d1490473077cdb9b338, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 04:53:54,594 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 8e73f1dee66a4a3d820d8fd4ef6f8de7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 04:53:54,594 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 011587db1511416ebe63ddd5bce9d885, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 04:53:54,594 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 7b2c50ebeae74fa78a3f6224a6540d56, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 04:53:54,594 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting bda5d2cee820458e9fc286351df0d686_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 04:53:54,595 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:53:54,596 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:53:54,598 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101d82b2387c2744b02a9cb15d5287c1fae to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101d82b2387c2744b02a9cb15d5287c1fae 2023-11-11 04:53:54,599 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b895730ed5ee49989a7e2db28c1113ce to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b895730ed5ee49989a7e2db28c1113ce 2023-11-11 04:53:54,599 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-11 04:53:54,599 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-11 04:53:54,602 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:53:54,602 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:53:54,633 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 76461f05efc482fa7730ea065191b0d6#family1#compaction#22 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:53:55,455 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/140e9be0e10444e0918a2f82a490a0b9 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/140e9be0e10444e0918a2f82a490a0b9 2023-11-11 04:53:55,459 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231542fe57821314019b6f0aca706a84491 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231542fe57821314019b6f0aca706a84491 2023-11-11 04:53:55,460 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:53:55,461 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 76461f05efc482fa7730ea065191b0d6/family1 of 76461f05efc482fa7730ea065191b0d6 into 140e9be0e10444e0918a2f82a490a0b9(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:53:55,461 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:55,461 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699678434593; duration=0sec 2023-11-11 04:53:55,461 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:53:55,485 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6e0267207dda4a5ba19947369587e4ec first=Optional[r1] last=Optional[r4] 2023-11-11 04:53:55,485 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6e0267207dda4a5ba19947369587e4ec}] 2023-11-11 04:53:55,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6e0267207dda4a5ba19947369587e4ec for inclusion in 76461f05efc482fa7730ea065191b0d6/family1 2023-11-11 04:53:55,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-11 04:53:55,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:53:55,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:55,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6e0267207dda4a5ba19947369587e4ec to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9th86c6roc6n848ei8a3qdinutg8u6vto0f5gbf5e6eob3osdbspmg9r61a8i52i/family1/6e0267207dda4a5ba19947369587e4ec 2023-11-11 04:53:55,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9th86c6roc6n848ei8a3qdinutg8u6vto0f5gbf5e6eob3osdbspmg9r61a8i52i/family1/6e0267207dda4a5ba19947369587e4ec as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/c046824e20ac4b6ebd13399fcc0f6bdf_SeqId_47_ 2023-11-11 04:53:55,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9th86c6roc6n848ei8a3qdinutg8u6vto0f5gbf5e6eob3osdbspmg9r61a8i52i/family1/6e0267207dda4a5ba19947369587e4ec into 76461f05efc482fa7730ea065191b0d6/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/c046824e20ac4b6ebd13399fcc0f6bdf_SeqId_47_ - updating store file list. 2023-11-11 04:53:55,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/c046824e20ac4b6ebd13399fcc0f6bdf_SeqId_47_ into 76461f05efc482fa7730ea065191b0d6/family1 2023-11-11 04:53:55,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9th86c6roc6n848ei8a3qdinutg8u6vto0f5gbf5e6eob3osdbspmg9r61a8i52i/family1/6e0267207dda4a5ba19947369587e4ec into 76461f05efc482fa7730ea065191b0d6/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/c046824e20ac4b6ebd13399fcc0f6bdf_SeqId_47_) 2023-11-11 04:53:55,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9th86c6roc6n848ei8a3qdinutg8u6vto0f5gbf5e6eob3osdbspmg9r61a8i52i/family1/6e0267207dda4a5ba19947369587e4ec 2023-11-11 04:53:55,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 04:53:55,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 04:53:55,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): 76461f05efc482fa7730ea065191b0d6/family1 is initiating minor compaction (all files) 2023-11-11 04:53:55,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@213c83fb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:53:55,500 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 76461f05efc482fa7730ea065191b0d6/family1 in testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:53:55,501 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9b2103d9be65427fa0cdba761ec0103c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/140e9be0e10444e0918a2f82a490a0b9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/c046824e20ac4b6ebd13399fcc0f6bdf_SeqId_47_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp, totalSize=178.1 K 2023-11-11 04:53:55,501 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 9b2103d9be65427fa0cdba761ec0103c, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828286 2023-11-11 04:53:55,501 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 140e9be0e10444e0918a2f82a490a0b9, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228286 2023-11-11 04:53:55,502 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting c046824e20ac4b6ebd13399fcc0f6bdf_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965228286 2023-11-11 04:53:55,502 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:53:55,503 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:53:55,505 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018f056c15825d472599cd6f0879911270 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018f056c15825d472599cd6f0879911270 2023-11-11 04:53:55,506 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205892764e262ed45b08fd7078e06a6c04a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205892764e262ed45b08fd7078e06a6c04a 2023-11-11 04:53:55,508 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122808dc34175fa7480e8bcdbe5f771fba8b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122808dc34175fa7480e8bcdbe5f771fba8b 2023-11-11 04:53:55,509 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231346f7c53a7ff45ec934fbbb7224dd575 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231346f7c53a7ff45ec934fbbb7224dd575 2023-11-11 04:53:55,509 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-11 04:53:55,509 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-11 04:53:55,510 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:53:55,510 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:53:55,528 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 76461f05efc482fa7730ea065191b0d6#family1#compaction#23 average throughput is 9.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:53:55,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9d29d4515e6746c68c0aab72383f8698, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b583ee4fbaab49c9b504f1e8a7cd29cf, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/762de4abb66047009a573124ecef8ca4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/d7a2639dfc204a63a85dc8a0af5d15bd, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b8d98e742e2b41adac9c1c704cc5bc56, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9529236f07144d1490473077cdb9b338, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/8e73f1dee66a4a3d820d8fd4ef6f8de7, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/011587db1511416ebe63ddd5bce9d885, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/7b2c50ebeae74fa78a3f6224a6540d56, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/bda5d2cee820458e9fc286351df0d686_SeqId_44_] to archive 2023-11-11 04:53:55,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:53:55,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9d29d4515e6746c68c0aab72383f8698 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9d29d4515e6746c68c0aab72383f8698 2023-11-11 04:53:55,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b583ee4fbaab49c9b504f1e8a7cd29cf to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b583ee4fbaab49c9b504f1e8a7cd29cf 2023-11-11 04:53:55,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/762de4abb66047009a573124ecef8ca4 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/762de4abb66047009a573124ecef8ca4 2023-11-11 04:53:55,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/d7a2639dfc204a63a85dc8a0af5d15bd to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/d7a2639dfc204a63a85dc8a0af5d15bd 2023-11-11 04:53:55,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b8d98e742e2b41adac9c1c704cc5bc56 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/b8d98e742e2b41adac9c1c704cc5bc56 2023-11-11 04:53:55,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9529236f07144d1490473077cdb9b338 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9529236f07144d1490473077cdb9b338 2023-11-11 04:53:55,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/8e73f1dee66a4a3d820d8fd4ef6f8de7 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/8e73f1dee66a4a3d820d8fd4ef6f8de7 2023-11-11 04:53:55,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/011587db1511416ebe63ddd5bce9d885 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/011587db1511416ebe63ddd5bce9d885 2023-11-11 04:53:55,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/7b2c50ebeae74fa78a3f6224a6540d56 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/7b2c50ebeae74fa78a3f6224a6540d56 2023-11-11 04:53:55,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/bda5d2cee820458e9fc286351df0d686_SeqId_44_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/bda5d2cee820458e9fc286351df0d686_SeqId_44_ 2023-11-11 04:53:56,389 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303b02bbc13831417e9eba2d4e4fccf628 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511303b02bbc13831417e9eba2d4e4fccf628 2023-11-11 04:53:56,390 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:53:56,415 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50ee9be201a84370a6b8464ff1621b3b first=Optional[r00] last=Optional[r8] 2023-11-11 04:53:56,415 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50ee9be201a84370a6b8464ff1621b3b}] 2023-11-11 04:53:56,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50ee9be201a84370a6b8464ff1621b3b for inclusion in 76461f05efc482fa7730ea065191b0d6/family1 2023-11-11 04:53:56,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-11 04:53:56,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:53:56,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:56,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/50ee9be201a84370a6b8464ff1621b3b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gofsolgep1cpfngm37q1lkdviudij5cp4gmf226f0gqe6rf43bh031isggosojip/family1/50ee9be201a84370a6b8464ff1621b3b 2023-11-11 04:53:56,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gofsolgep1cpfngm37q1lkdviudij5cp4gmf226f0gqe6rf43bh031isggosojip/family1/50ee9be201a84370a6b8464ff1621b3b as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/76f10f827a784a6b82b3c6458831c96a_SeqId_49_ 2023-11-11 04:53:56,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gofsolgep1cpfngm37q1lkdviudij5cp4gmf226f0gqe6rf43bh031isggosojip/family1/50ee9be201a84370a6b8464ff1621b3b into 76461f05efc482fa7730ea065191b0d6/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/76f10f827a784a6b82b3c6458831c96a_SeqId_49_ - updating store file list. 2023-11-11 04:53:56,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/76f10f827a784a6b82b3c6458831c96a_SeqId_49_ into 76461f05efc482fa7730ea065191b0d6/family1 2023-11-11 04:53:56,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gofsolgep1cpfngm37q1lkdviudij5cp4gmf226f0gqe6rf43bh031isggosojip/family1/50ee9be201a84370a6b8464ff1621b3b into 76461f05efc482fa7730ea065191b0d6/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/76f10f827a784a6b82b3c6458831c96a_SeqId_49_) 2023-11-11 04:53:56,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gofsolgep1cpfngm37q1lkdviudij5cp4gmf226f0gqe6rf43bh031isggosojip/family1/50ee9be201a84370a6b8464ff1621b3b 2023-11-11 04:53:56,431 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:53:56,431 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:53:56,433 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120242c4be6f03c483f8f573397a9b0bade to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120242c4be6f03c483f8f573397a9b0bade 2023-11-11 04:53:56,434 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511283886e4d40059476c9ea8c376be769fd4 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511283886e4d40059476c9ea8c376be769fd4 2023-11-11 04:53:56,435 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511307a408a5f9e564d0da7426663d07a6e9e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511307a408a5f9e564d0da7426663d07a6e9e 2023-11-11 04:53:56,435 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-11 04:53:56,435 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-11 04:53:56,436 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:53:56,436 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:53:56,436 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:53:56,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:53:56,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:53:56,437 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:53:56,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.7450 sec 2023-11-11 04:53:56,529 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=261 (was 248) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-192606000_17 at /127.0.0.1:55962 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x610aef6a-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56038 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ef5f838-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x610aef6a-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56090 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56142 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56058 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x610aef6a-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56156 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56154 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56116 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56172 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:35188 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x610aef6a-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56094 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x610aef6a-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61842@0x21fe50d5-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56002 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x610aef6a-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56106 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x610aef6a-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56160 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56132 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61842@0x21fe50d5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/2013315585.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/eb893949fa3c42cb9990f8d2f32c636b java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56168 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61842@0x21fe50d5-SendThread(127.0.0.1:61842) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-192606000_17 at /127.0.0.1:35182 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56064 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717500159_17 at /127.0.0.1:56150 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=641 (was 614) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=223 (was 276), ProcessCount=169 (was 169), AvailableMemoryMB=2115 (was 2292) 2023-11-11 04:53:56,541 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=260, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=223, ProcessCount=169, AvailableMemoryMB=2115 2023-11-11 04:53:56,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 04:53:56,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:56,546 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:53:56,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-11 04:53:56,547 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:53:56,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-11 04:53:56,549 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396 2023-11-11 04:53:56,550 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396 empty. 2023-11-11 04:53:56,550 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396 2023-11-11 04:53:56,550 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-11 04:53:56,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-11 04:53:56,773 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/.tmp/family1/eb893949fa3c42cb9990f8d2f32c636b as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/eb893949fa3c42cb9990f8d2f32c636b 2023-11-11 04:53:56,779 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 76461f05efc482fa7730ea065191b0d6/family1 of 76461f05efc482fa7730ea065191b0d6 into eb893949fa3c42cb9990f8d2f32c636b(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:53:56,779 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:53:56,779 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1699678435500; duration=1sec 2023-11-11 04:53:56,779 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:53:56,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9b2103d9be65427fa0cdba761ec0103c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/140e9be0e10444e0918a2f82a490a0b9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/c046824e20ac4b6ebd13399fcc0f6bdf_SeqId_47_] to archive 2023-11-11 04:53:56,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:53:56,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9b2103d9be65427fa0cdba761ec0103c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/9b2103d9be65427fa0cdba761ec0103c 2023-11-11 04:53:56,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/140e9be0e10444e0918a2f82a490a0b9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/140e9be0e10444e0918a2f82a490a0b9 2023-11-11 04:53:56,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/c046824e20ac4b6ebd13399fcc0f6bdf_SeqId_47_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/family1/c046824e20ac4b6ebd13399fcc0f6bdf_SeqId_47_ 2023-11-11 04:53:56,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-11 04:53:56,961 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-11 04:53:56,963 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 56b66f90356641deea4e629f16f10396, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:53:57,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-11 04:53:57,369 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:57,369 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 56b66f90356641deea4e629f16f10396, disabling compactions & flushes 2023-11-11 04:53:57,369 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:53:57,369 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:53:57,369 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. after waiting 0 ms 2023-11-11 04:53:57,369 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:53:57,369 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:53:57,369 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:53:57,371 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:53:57,373 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699678437372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678437372"}]},"ts":"1699678437372"} 2023-11-11 04:53:57,374 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 04:53:57,375 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:53:57,375 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678437375"}]},"ts":"1699678437375"} 2023-11-11 04:53:57,376 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-11 04:53:57,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=56b66f90356641deea4e629f16f10396, ASSIGN}] 2023-11-11 04:53:57,380 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=56b66f90356641deea4e629f16f10396, ASSIGN 2023-11-11 04:53:57,381 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=56b66f90356641deea4e629f16f10396, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:53:57,532 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=56b66f90356641deea4e629f16f10396, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:57,532 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699678437532"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678437532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678437532"}]},"ts":"1699678437532"} 2023-11-11 04:53:57,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 56b66f90356641deea4e629f16f10396, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:53:57,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-11 04:53:57,686 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:57,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:53:57,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 56b66f90356641deea4e629f16f10396, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:53:57,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 56b66f90356641deea4e629f16f10396 2023-11-11 04:53:57,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:53:57,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 56b66f90356641deea4e629f16f10396 2023-11-11 04:53:57,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 56b66f90356641deea4e629f16f10396 2023-11-11 04:53:57,691 INFO [StoreOpener-56b66f90356641deea4e629f16f10396-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 56b66f90356641deea4e629f16f10396 2023-11-11 04:53:57,692 DEBUG [StoreOpener-56b66f90356641deea4e629f16f10396-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1 2023-11-11 04:53:57,692 DEBUG [StoreOpener-56b66f90356641deea4e629f16f10396-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1 2023-11-11 04:53:57,693 INFO [StoreOpener-56b66f90356641deea4e629f16f10396-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56b66f90356641deea4e629f16f10396 columnFamilyName family1 2023-11-11 04:53:57,694 INFO [StoreOpener-56b66f90356641deea4e629f16f10396-1] regionserver.HStore(310): Store=56b66f90356641deea4e629f16f10396/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:53:57,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396 2023-11-11 04:53:57,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396 2023-11-11 04:53:57,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 56b66f90356641deea4e629f16f10396 2023-11-11 04:53:57,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:53:57,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 56b66f90356641deea4e629f16f10396; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68739144, jitterRate=0.024293065071105957}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:53:57,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:53:57,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396., pid=25, masterSystemTime=1699678437686 2023-11-11 04:53:57,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:53:57,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:53:57,703 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=56b66f90356641deea4e629f16f10396, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:57,703 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699678437703"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678437703"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678437703"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678437703"}]},"ts":"1699678437703"} 2023-11-11 04:53:57,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-11 04:53:57,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 56b66f90356641deea4e629f16f10396, server=jenkins-hbase4.apache.org,43941,1699678403879 in 171 msec 2023-11-11 04:53:57,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-11 04:53:57,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=56b66f90356641deea4e629f16f10396, ASSIGN in 327 msec 2023-11-11 04:53:57,709 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:53:57,709 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678437709"}]},"ts":"1699678437709"} 2023-11-11 04:53:57,711 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-11 04:53:57,713 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:53:57,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1690 sec 2023-11-11 04:53:58,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-11 04:53:58,653 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-11 04:53:58,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:58,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:58,680 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:53:58,680 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:58,680 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:53:58,680 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:58,680 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:58,680 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:58,683 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:58,683 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:58,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:58,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:58,683 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:58,684 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:58,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:58,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:58,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:58,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:58,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:58,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:58,685 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:53:58,685 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:58,685 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:53:58,685 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:58,685 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:58,685 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:53:58,685 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. started... 2023-11-11 04:53:58,686 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 56b66f90356641deea4e629f16f10396 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 04:53:58,708 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a5a49c16c0324ed38a8a2bec1d9bae7b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130a5a49c16c0324ed38a8a2bec1d9bae7b 2023-11-11 04:53:59,112 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/0dcc6e2dbad648d89b1fd7ff886f22e1 2023-11-11 04:53:59,117 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/0dcc6e2dbad648d89b1fd7ff886f22e1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/0dcc6e2dbad648d89b1fd7ff886f22e1 2023-11-11 04:53:59,123 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/0dcc6e2dbad648d89b1fd7ff886f22e1, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-11 04:53:59,124 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 56b66f90356641deea4e629f16f10396 in 438ms, sequenceid=5, compaction requested=false 2023-11-11 04:53:59,124 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:53:59,125 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:53:59,125 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:53:59,125 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:53:59,125 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:53:59,125 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,125 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:53:59,125 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:53:59,127 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,127 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:59,127 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,127 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:53:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:59,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:59,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:53:59,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a74f7e0[Count = 0] remaining members to acquire global barrier 2023-11-11 04:53:59,129 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:53:59,129 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,130 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,130 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:53:59,130 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:53:59,130 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:53:59,130 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,130 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:53:59,131 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,131 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:53:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:59,131 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:59,132 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:53:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:53:59,134 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:53:59,135 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:53:59,135 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:53:59,135 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,135 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:53:59,137 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,137 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:53:59,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,138 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:53:59,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:59,138 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,139 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:53:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,142 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,142 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,142 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:59,142 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,142 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:53:59,142 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:53:59,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:53:59,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:59,142 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:53:59,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:59,142 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,142 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,142 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:53:59,142 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:53:59,142 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:53:59,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:53:59,243 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:53:59,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:53:59,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:53:59,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:53:59,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,249 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:53:59,249 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:59,249 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:53:59,249 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:53:59,250 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,250 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,251 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,251 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:53:59,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:53:59,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:53:59,252 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:53:59,252 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:53:59,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:53:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,253 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:53:59,253 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:53:59,253 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:53:59,253 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:53:59,253 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:53:59,253 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:53:59,253 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:53:59,253 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:53:59,253 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. started... 2023-11-11 04:53:59,253 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 56b66f90356641deea4e629f16f10396 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 04:53:59,667 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128da7073a6ecc24c729623ce757eb033cc to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128da7073a6ecc24c729623ce757eb033cc 2023-11-11 04:54:00,073 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/ad91d410dd0f455c83fe7bdf75f8ac84 2023-11-11 04:54:00,078 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/ad91d410dd0f455c83fe7bdf75f8ac84 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ad91d410dd0f455c83fe7bdf75f8ac84 2023-11-11 04:54:00,083 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ad91d410dd0f455c83fe7bdf75f8ac84, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 04:54:00,084 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 56b66f90356641deea4e629f16f10396 in 831ms, sequenceid=9, compaction requested=false 2023-11-11 04:54:00,084 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:00,084 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:00,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:00,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:00,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:00,084 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:00,090 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,090 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:00,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:00,090 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,090 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:00,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:00,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:00,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:00,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:00,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63117f19[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:00,092 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:00,092 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,093 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,093 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:00,093 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:00,093 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,093 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:00,093 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:00,094 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,094 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:00,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:00,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:00,094 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:00,094 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:00,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:00,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:00,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:00,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:00,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:00,097 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:00,097 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:00,097 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:00,097 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,097 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:00,098 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,098 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:00,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,098 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:00,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:00,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:00,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:00,099 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:00,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,100 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:00,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,103 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,103 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,103 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:00,103 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:00,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:00,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:00,103 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:00,103 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,103 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:00,103 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:00,103 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:00,103 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,104 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:00,104 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:00,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:00,204 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:00,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:00,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:00,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:00,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,210 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:00,210 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:00,210 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:00,210 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:00,211 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,211 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,212 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:00,212 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:00,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:00,212 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:00,213 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:00,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:00,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,213 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,213 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:00,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:00,214 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:00,214 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:00,214 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:00,214 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:00,214 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:00,214 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:00,214 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. started... 2023-11-11 04:54:00,214 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 56b66f90356641deea4e629f16f10396 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:00,627 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120193950313ce4c48c1b1f55436eef82722 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120193950313ce4c48c1b1f55436eef82722 2023-11-11 04:54:01,032 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/a4097ef6986549e1a90a5e92d105324c 2023-11-11 04:54:01,038 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/a4097ef6986549e1a90a5e92d105324c as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/a4097ef6986549e1a90a5e92d105324c 2023-11-11 04:54:01,042 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/a4097ef6986549e1a90a5e92d105324c, entries=1, sequenceid=13, filesize=4.9 K 2023-11-11 04:54:01,043 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56b66f90356641deea4e629f16f10396 in 829ms, sequenceid=13, compaction requested=true 2023-11-11 04:54:01,043 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:01,044 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:01,044 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:01,044 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:01,044 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,044 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:01,044 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:01,045 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,045 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:01,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:01,046 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,046 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:01,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:01,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:01,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:01,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:01,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41c44331[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:01,047 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:01,047 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,048 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,049 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:01,049 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:01,049 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,049 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:01,049 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:01,051 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:01,051 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,051 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:01,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:01,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:01,051 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:01,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:01,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:01,053 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:01,054 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:01,054 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:01,054 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,054 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:01,055 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,055 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,055 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:01,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:01,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:01,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:01,056 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:01,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,057 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:01,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,059 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,059 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:01,059 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,059 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:01,059 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:01,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 04:54:01,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:01,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:01,059 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,059 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:01,060 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:01,060 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,060 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,060 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:01,060 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:01,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:01,160 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:01,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:01,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:01,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:01,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,167 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:01,167 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:01,167 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:01,167 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:01,168 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,168 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,169 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,169 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:01,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:01,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:01,169 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:01,169 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:01,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:01,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,170 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,170 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:01,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:01,170 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:01,170 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:01,170 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:01,171 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:01,171 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:01,171 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:01,171 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. started... 2023-11-11 04:54:01,171 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 56b66f90356641deea4e629f16f10396 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:01,584 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052637c05348d04c74be871c1d66f5a1ed to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052637c05348d04c74be871c1d66f5a1ed 2023-11-11 04:54:01,990 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/44b0ed01e9df4dde9e01d69e7abc5dc0 2023-11-11 04:54:01,996 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/44b0ed01e9df4dde9e01d69e7abc5dc0 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/44b0ed01e9df4dde9e01d69e7abc5dc0 2023-11-11 04:54:02,000 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/44b0ed01e9df4dde9e01d69e7abc5dc0, entries=1, sequenceid=17, filesize=4.9 K 2023-11-11 04:54:02,001 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56b66f90356641deea4e629f16f10396 in 830ms, sequenceid=17, compaction requested=true 2023-11-11 04:54:02,001 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:02,001 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:02,001 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:02,001 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:02,001 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,001 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:02,002 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:02,004 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,004 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:02,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:02,004 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,004 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:02,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:02,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:02,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:02,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:02,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@91ed5e7[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:02,006 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:02,006 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,007 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:02,007 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:02,008 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:02,008 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,008 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:02,009 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,009 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:02,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:02,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:02,009 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:02,009 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:02,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:02,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:02,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:02,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:02,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:02,011 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:02,012 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:02,012 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:02,012 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,012 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:02,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:02,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:02,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:02,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:02,014 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:02,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:02,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,015 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:02,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,022 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,022 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,022 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:02,022 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:02,022 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,022 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:02,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:02,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:02,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:02,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,023 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:02,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:02,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:02,023 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:02,123 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:02,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:02,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:02,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:02,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,130 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:02,130 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:02,130 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:02,130 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:02,131 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,131 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,132 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:02,132 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:02,132 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,132 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,133 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,133 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:02,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,133 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:02,133 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:02,134 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:02,134 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:02,134 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:02,134 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:02,134 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. started... 2023-11-11 04:54:02,134 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 56b66f90356641deea4e629f16f10396 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:02,548 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e4cbd586db484a5593f9a9822420cd74 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228e4cbd586db484a5593f9a9822420cd74 2023-11-11 04:54:02,954 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/41bc866b5ebd4fbabe6a97ba6ffbdba1 2023-11-11 04:54:02,960 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/41bc866b5ebd4fbabe6a97ba6ffbdba1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/41bc866b5ebd4fbabe6a97ba6ffbdba1 2023-11-11 04:54:02,964 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/41bc866b5ebd4fbabe6a97ba6ffbdba1, entries=1, sequenceid=21, filesize=4.9 K 2023-11-11 04:54:02,965 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56b66f90356641deea4e629f16f10396 in 831ms, sequenceid=21, compaction requested=true 2023-11-11 04:54:02,965 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:02,965 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:02,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:02,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:02,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:02,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:02,967 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,967 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:02,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:02,967 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,968 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:02,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:02,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24f8e8d3[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:02,969 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:02,969 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,970 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,970 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:02,971 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:02,971 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,971 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:02,973 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:02,973 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,974 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:02,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:02,974 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:02,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:02,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:02,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:02,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:02,976 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:02,976 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:02,976 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:02,976 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,976 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:02,978 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,978 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:02,978 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:02,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:02,979 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,980 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,982 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,982 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,982 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:02,982 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:02,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:02,982 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:02,982 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:02,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:02,982 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:02,983 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:02,982 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,983 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:02,983 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,983 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:02,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:03,083 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:03,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:03,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:03,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:03,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,090 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:03,090 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:03,090 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:03,090 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:03,090 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,090 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,092 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,092 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:03,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:03,092 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,092 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,093 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,093 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:03,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,093 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:03,093 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:03,093 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:03,094 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:03,094 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:03,094 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:03,094 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. started... 2023-11-11 04:54:03,094 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 56b66f90356641deea4e629f16f10396 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:03,216 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:54:03,508 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318761408916f341709dd9da3bc76b853a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512318761408916f341709dd9da3bc76b853a 2023-11-11 04:54:03,914 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/c0dd8db4e90240fba9734d1e51a9f6c1 2023-11-11 04:54:03,919 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/c0dd8db4e90240fba9734d1e51a9f6c1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/c0dd8db4e90240fba9734d1e51a9f6c1 2023-11-11 04:54:03,924 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/c0dd8db4e90240fba9734d1e51a9f6c1, entries=1, sequenceid=25, filesize=4.9 K 2023-11-11 04:54:03,925 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56b66f90356641deea4e629f16f10396 in 831ms, sequenceid=25, compaction requested=true 2023-11-11 04:54:03,925 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:03,925 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:03,925 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:03,925 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:03,925 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,925 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:03,925 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:03,927 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,927 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:03,928 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:03,928 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cf9b2e2[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:03,929 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:03,929 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,930 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,931 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:03,931 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:03,931 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:03,931 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,931 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:03,932 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,932 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:03,932 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:03,932 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:03,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:03,935 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:03,935 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:03,935 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:03,935 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,935 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:03,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:03,937 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:03,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:03,937 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,938 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:03,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,941 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,941 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,941 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:03,941 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:03,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:03,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:03,941 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:03,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:03,941 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:03,941 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:03,942 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:03,942 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:03,942 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 04:54:03,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:03,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:03,942 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:03,942 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,042 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:04,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:04,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:04,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:04,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,049 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:04,049 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:04,049 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:04,049 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:04,049 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,049 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,050 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:04,050 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:04,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:04,051 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,051 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:04,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:04,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,052 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,052 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:04,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,052 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:04,052 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:04,052 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:04,054 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:04,054 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:04,054 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:04,054 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. started... 2023-11-11 04:54:04,054 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 56b66f90356641deea4e629f16f10396 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:04,467 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a2f6521bf25a49fd80d50ee246ee2b68 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101a2f6521bf25a49fd80d50ee246ee2b68 2023-11-11 04:54:04,873 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/ff8b6d2e82834f4bbea9ffc1b2494dab 2023-11-11 04:54:04,879 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/ff8b6d2e82834f4bbea9ffc1b2494dab as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ff8b6d2e82834f4bbea9ffc1b2494dab 2023-11-11 04:54:04,883 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ff8b6d2e82834f4bbea9ffc1b2494dab, entries=1, sequenceid=29, filesize=4.9 K 2023-11-11 04:54:04,884 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56b66f90356641deea4e629f16f10396 in 830ms, sequenceid=29, compaction requested=true 2023-11-11 04:54:04,884 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:04,884 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:04,884 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:04,884 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:04,884 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,884 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:04,884 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:04,886 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:04,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:04,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:04,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:04,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fc7bd87[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:04,888 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:04,888 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,889 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,889 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:04,889 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:04,889 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:04,889 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,889 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:04,891 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:04,891 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:04,891 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,891 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:04,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:04,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:04,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:04,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:04,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:04,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:04,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:04,894 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:04,894 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:04,894 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:04,894 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,894 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:04,902 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,902 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,903 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:04,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,903 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:04,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:04,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:04,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,904 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:04,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,907 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,907 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,907 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:04,907 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:04,907 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:04,907 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:04,907 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:04,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 04:54:04,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:04,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:04,907 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:04,907 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,907 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:04,908 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:04,908 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:04,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:04,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:05,008 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:05,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:05,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:05,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:05,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,015 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:05,015 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:05,015 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:05,015 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:05,015 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,016 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,018 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:05,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:05,018 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,018 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,019 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,019 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:05,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,019 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:05,019 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:05,020 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:05,020 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:05,020 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:05,020 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:05,020 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. started... 2023-11-11 04:54:05,020 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 56b66f90356641deea4e629f16f10396 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:05,433 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e32c09fc59724fbc8380ac69b909b75a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103e32c09fc59724fbc8380ac69b909b75a 2023-11-11 04:54:05,839 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/abb0bfd52b3b47409f0ee483a475bdfc 2023-11-11 04:54:05,844 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/abb0bfd52b3b47409f0ee483a475bdfc as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/abb0bfd52b3b47409f0ee483a475bdfc 2023-11-11 04:54:05,849 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/abb0bfd52b3b47409f0ee483a475bdfc, entries=1, sequenceid=33, filesize=4.9 K 2023-11-11 04:54:05,850 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56b66f90356641deea4e629f16f10396 in 830ms, sequenceid=33, compaction requested=true 2023-11-11 04:54:05,850 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:05,850 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:05,850 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:05,850 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:05,850 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,850 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:05,850 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:05,852 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,852 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:05,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:05,852 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,852 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:05,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:05,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:05,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:05,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:05,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5089e475[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:05,854 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:05,854 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,855 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,855 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:05,855 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:05,855 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:05,855 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,855 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:05,856 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,856 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:05,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:05,857 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:05,857 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:05,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:05,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:05,859 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:05,859 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:05,859 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:05,859 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,859 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:05,861 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,861 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:05,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,862 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:05,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:05,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:05,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:05,862 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:05,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:05,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,863 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:05,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,866 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,866 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,866 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:05,866 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,866 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:05,866 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,866 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:05,866 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,866 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 04:54:05,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:05,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:05,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:05,866 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:05,866 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:05,866 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:05,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:05,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:05,967 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:05,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:05,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:05,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:05,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,973 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:05,973 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:05,973 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:05,973 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:05,974 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,974 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,975 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:05,975 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:05,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:05,976 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:05,976 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:05,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:05,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,977 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,977 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:05,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:05,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:05,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:05,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:05,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:05,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:05,977 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:05,977 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. started... 2023-11-11 04:54:05,977 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 56b66f90356641deea4e629f16f10396 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:06,391 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090743a416c170b64d9fa084f74bc163b1ea to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015090743a416c170b64d9fa084f74bc163b1ea 2023-11-11 04:54:06,397 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/97589dd66613495cbfc93aaa2d6b67c8 2023-11-11 04:54:06,401 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/97589dd66613495cbfc93aaa2d6b67c8 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/97589dd66613495cbfc93aaa2d6b67c8 2023-11-11 04:54:06,406 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/97589dd66613495cbfc93aaa2d6b67c8, entries=1, sequenceid=37, filesize=4.9 K 2023-11-11 04:54:06,407 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56b66f90356641deea4e629f16f10396 in 430ms, sequenceid=37, compaction requested=true 2023-11-11 04:54:06,407 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:06,407 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:06,407 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:06,407 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:06,407 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,407 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:06,407 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:06,409 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,409 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:06,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:06,410 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,410 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:06,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:06,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33d430c7[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:06,411 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:06,411 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,413 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,413 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:06,413 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:06,413 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:06,414 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,414 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:06,415 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,415 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:06,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:06,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:06,415 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:06,415 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:06,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:06,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:06,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:06,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:06,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:06,417 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:06,417 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:06,417 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:06,417 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,417 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:06,419 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,419 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:06,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:06,419 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:06,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:06,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:06,420 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,421 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:06,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,423 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,423 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:06,423 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,424 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:06,424 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:06,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:06,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:06,424 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,424 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:06,424 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:06,424 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,424 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:06,424 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,424 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:06,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:06,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:06,524 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:06,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:06,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:06,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:06,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,531 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:06,531 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:06,531 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:06,531 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:06,532 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,532 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,534 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,534 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:06,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:06,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:06,534 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:06,534 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:06,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:06,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,535 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,535 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:06,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:06,535 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:06,536 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:06,536 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:06,536 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:06,536 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:06,536 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:06,536 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. started... 2023-11-11 04:54:06,536 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 56b66f90356641deea4e629f16f10396 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:06,949 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120fb9eaa09f4ad496cb01558d830277c0a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120fb9eaa09f4ad496cb01558d830277c0a 2023-11-11 04:54:07,355 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/52398f8590034b98a780652708177ceb 2023-11-11 04:54:07,360 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/52398f8590034b98a780652708177ceb as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/52398f8590034b98a780652708177ceb 2023-11-11 04:54:07,365 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/52398f8590034b98a780652708177ceb, entries=1, sequenceid=41, filesize=4.9 K 2023-11-11 04:54:07,366 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56b66f90356641deea4e629f16f10396 in 830ms, sequenceid=41, compaction requested=true 2023-11-11 04:54:07,366 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:07,366 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:07,366 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:07,366 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:07,366 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,366 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:07,366 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:07,371 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,371 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:07,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:07,372 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,372 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:07,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:07,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:07,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:07,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:07,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32bbfafd[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:07,373 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:07,373 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,375 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,375 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:07,375 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:07,375 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:07,375 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,375 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:07,378 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,378 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:07,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:07,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:07,378 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:07,378 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:07,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:07,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:07,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:07,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:07,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:07,380 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:07,380 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:07,380 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:07,380 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,380 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:07,382 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,382 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,382 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:07,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:07,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:07,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:07,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:07,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:07,382 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:07,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,384 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:07,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,386 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,386 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:07,386 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,387 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:07,387 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 04:54:07,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:07,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:07,387 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:07,387 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:07,387 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,387 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,387 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:07,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:07,387 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:07,387 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,487 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:07,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:07,489 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-11 04:54:07,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:54:07,492 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:54:07,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:07,493 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679047493 2023-11-11 04:54:07,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 04:54:07,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-11 04:54:07,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:07,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x441dc53d to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:54:07,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72da036b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:54:07,503 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:08,351 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032a0cba72af7f459995b8bafbde1f5383 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601032a0cba72af7f459995b8bafbde1f5383 2023-11-11 04:54:08,353 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:08,371 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:54:08,373 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:54:08,380 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:54:08,382 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:54:08,391 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9478c865a032444d8744f25f6b8cf368 first=Optional[r3] last=Optional[r6] 2023-11-11 04:54:08,392 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9478c865a032444d8744f25f6b8cf368}] 2023-11-11 04:54:08,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9478c865a032444d8744f25f6b8cf368 for inclusion in 56b66f90356641deea4e629f16f10396/family1 2023-11-11 04:54:08,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-11 04:54:08,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:54:08,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:08,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9478c865a032444d8744f25f6b8cf368 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithWeeklyPolicy__7qj5qogbb4ir54rq97k8lef5oi2cbccl0dnmlgujj298ctu1e2u92gvm082ncu0k/family1/9478c865a032444d8744f25f6b8cf368 2023-11-11 04:54:08,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithWeeklyPolicy__7qj5qogbb4ir54rq97k8lef5oi2cbccl0dnmlgujj298ctu1e2u92gvm082ncu0k/family1/9478c865a032444d8744f25f6b8cf368 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/33056a3ce32d42a79c1694e861abd75c_SeqId_44_ 2023-11-11 04:54:08,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithWeeklyPolicy__7qj5qogbb4ir54rq97k8lef5oi2cbccl0dnmlgujj298ctu1e2u92gvm082ncu0k/family1/9478c865a032444d8744f25f6b8cf368 into 56b66f90356641deea4e629f16f10396/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/33056a3ce32d42a79c1694e861abd75c_SeqId_44_ - updating store file list. 2023-11-11 04:54:08,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/33056a3ce32d42a79c1694e861abd75c_SeqId_44_ into 56b66f90356641deea4e629f16f10396/family1 2023-11-11 04:54:08,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithWeeklyPolicy__7qj5qogbb4ir54rq97k8lef5oi2cbccl0dnmlgujj298ctu1e2u92gvm082ncu0k/family1/9478c865a032444d8744f25f6b8cf368 into 56b66f90356641deea4e629f16f10396/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/33056a3ce32d42a79c1694e861abd75c_SeqId_44_) 2023-11-11 04:54:08,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithWeeklyPolicy__7qj5qogbb4ir54rq97k8lef5oi2cbccl0dnmlgujj298ctu1e2u92gvm082ncu0k/family1/9478c865a032444d8744f25f6b8cf368 2023-11-11 04:54:08,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 04:54:08,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 04:54:08,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): 56b66f90356641deea4e629f16f10396/family1 is initiating minor compaction 2023-11-11 04:54:08,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7969cc55; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:08,414 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 56b66f90356641deea4e629f16f10396/family1 in testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:08,414 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ad91d410dd0f455c83fe7bdf75f8ac84, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/a4097ef6986549e1a90a5e92d105324c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/44b0ed01e9df4dde9e01d69e7abc5dc0, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/41bc866b5ebd4fbabe6a97ba6ffbdba1, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/c0dd8db4e90240fba9734d1e51a9f6c1, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ff8b6d2e82834f4bbea9ffc1b2494dab, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/abb0bfd52b3b47409f0ee483a475bdfc, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/97589dd66613495cbfc93aaa2d6b67c8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/52398f8590034b98a780652708177ceb, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/33056a3ce32d42a79c1694e861abd75c_SeqId_44_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp, totalSize=50.0 K 2023-11-11 04:54:08,414 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting ad91d410dd0f455c83fe7bdf75f8ac84, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 04:54:08,415 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting a4097ef6986549e1a90a5e92d105324c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 04:54:08,415 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 44b0ed01e9df4dde9e01d69e7abc5dc0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 04:54:08,415 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 41bc866b5ebd4fbabe6a97ba6ffbdba1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 04:54:08,415 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting c0dd8db4e90240fba9734d1e51a9f6c1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 04:54:08,415 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting ff8b6d2e82834f4bbea9ffc1b2494dab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 04:54:08,415 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting abb0bfd52b3b47409f0ee483a475bdfc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 04:54:08,415 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 97589dd66613495cbfc93aaa2d6b67c8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 04:54:08,415 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 52398f8590034b98a780652708177ceb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 04:54:08,415 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 33056a3ce32d42a79c1694e861abd75c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 04:54:08,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:08,417 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:08,420 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228e4cbd586db484a5593f9a9822420cd74 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228e4cbd586db484a5593f9a9822420cd74 2023-11-11 04:54:08,421 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512318761408916f341709dd9da3bc76b853a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512318761408916f341709dd9da3bc76b853a 2023-11-11 04:54:08,422 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101a2f6521bf25a49fd80d50ee246ee2b68 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101a2f6521bf25a49fd80d50ee246ee2b68 2023-11-11 04:54:08,423 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103e32c09fc59724fbc8380ac69b909b75a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103e32c09fc59724fbc8380ac69b909b75a 2023-11-11 04:54:08,424 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-11 04:54:08,424 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-11 04:54:08,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:08,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:08,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:08,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:08,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:08,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:08,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:08,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:08,451 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 56b66f90356641deea4e629f16f10396#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:54:09,263 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205bcbea585494b4a15b0bb5b97a80a9455 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205bcbea585494b4a15b0bb5b97a80a9455 2023-11-11 04:54:09,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:09,270 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/643c8a884fd843fe9866e225ca07db85 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/643c8a884fd843fe9866e225ca07db85 2023-11-11 04:54:09,275 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 56b66f90356641deea4e629f16f10396/family1 of 56b66f90356641deea4e629f16f10396 into 643c8a884fd843fe9866e225ca07db85(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:54:09,276 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:09,276 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699678448414; duration=0sec 2023-11-11 04:54:09,276 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:09,289 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c6724f8d4cf4469d91c1434b74cdd2f9 first=Optional[r1] last=Optional[r2] 2023-11-11 04:54:09,290 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c6724f8d4cf4469d91c1434b74cdd2f9}] 2023-11-11 04:54:09,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c6724f8d4cf4469d91c1434b74cdd2f9 for inclusion in 56b66f90356641deea4e629f16f10396/family1 2023-11-11 04:54:09,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-11 04:54:09,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:54:09,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:09,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c6724f8d4cf4469d91c1434b74cdd2f9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cq2bndamc1k7kjl5pl3a6objo61t1nn7euk3jt2i3mvqm6fh5mu8kn9vcng18m2t/family1/c6724f8d4cf4469d91c1434b74cdd2f9 2023-11-11 04:54:09,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cq2bndamc1k7kjl5pl3a6objo61t1nn7euk3jt2i3mvqm6fh5mu8kn9vcng18m2t/family1/c6724f8d4cf4469d91c1434b74cdd2f9 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ec7120e9a3bd49688c212fbb7d7a4509_SeqId_47_ 2023-11-11 04:54:09,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cq2bndamc1k7kjl5pl3a6objo61t1nn7euk3jt2i3mvqm6fh5mu8kn9vcng18m2t/family1/c6724f8d4cf4469d91c1434b74cdd2f9 into 56b66f90356641deea4e629f16f10396/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ec7120e9a3bd49688c212fbb7d7a4509_SeqId_47_ - updating store file list. 2023-11-11 04:54:09,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ec7120e9a3bd49688c212fbb7d7a4509_SeqId_47_ into 56b66f90356641deea4e629f16f10396/family1 2023-11-11 04:54:09,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cq2bndamc1k7kjl5pl3a6objo61t1nn7euk3jt2i3mvqm6fh5mu8kn9vcng18m2t/family1/c6724f8d4cf4469d91c1434b74cdd2f9 into 56b66f90356641deea4e629f16f10396/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ec7120e9a3bd49688c212fbb7d7a4509_SeqId_47_) 2023-11-11 04:54:09,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cq2bndamc1k7kjl5pl3a6objo61t1nn7euk3jt2i3mvqm6fh5mu8kn9vcng18m2t/family1/c6724f8d4cf4469d91c1434b74cdd2f9 2023-11-11 04:54:09,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 04:54:09,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 04:54:09,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): 56b66f90356641deea4e629f16f10396/family1 is initiating minor compaction (all files) 2023-11-11 04:54:09,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@47018dda; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:09,305 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 56b66f90356641deea4e629f16f10396/family1 in testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:54:09,305 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/0dcc6e2dbad648d89b1fd7ff886f22e1, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/643c8a884fd843fe9866e225ca07db85, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ec7120e9a3bd49688c212fbb7d7a4509_SeqId_47_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp, totalSize=176.8 K 2023-11-11 04:54:09,306 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 0dcc6e2dbad648d89b1fd7ff886f22e1, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828286 2023-11-11 04:54:09,306 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 643c8a884fd843fe9866e225ca07db85, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228286 2023-11-11 04:54:09,306 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting ec7120e9a3bd49688c212fbb7d7a4509_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965228286 2023-11-11 04:54:09,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:09,307 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:09,309 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120193950313ce4c48c1b1f55436eef82722 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120193950313ce4c48c1b1f55436eef82722 2023-11-11 04:54:09,311 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052637c05348d04c74be871c1d66f5a1ed to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052637c05348d04c74be871c1d66f5a1ed 2023-11-11 04:54:09,311 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-11 04:54:09,311 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-11 04:54:09,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:09,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:09,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:09,313 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:54:09,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8230 sec 2023-11-11 04:54:09,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ad91d410dd0f455c83fe7bdf75f8ac84, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/a4097ef6986549e1a90a5e92d105324c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/44b0ed01e9df4dde9e01d69e7abc5dc0, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/41bc866b5ebd4fbabe6a97ba6ffbdba1, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/c0dd8db4e90240fba9734d1e51a9f6c1, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ff8b6d2e82834f4bbea9ffc1b2494dab, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/abb0bfd52b3b47409f0ee483a475bdfc, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/97589dd66613495cbfc93aaa2d6b67c8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/52398f8590034b98a780652708177ceb, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/33056a3ce32d42a79c1694e861abd75c_SeqId_44_] to archive 2023-11-11 04:54:09,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:09,327 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ad91d410dd0f455c83fe7bdf75f8ac84 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ad91d410dd0f455c83fe7bdf75f8ac84 2023-11-11 04:54:09,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/a4097ef6986549e1a90a5e92d105324c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/a4097ef6986549e1a90a5e92d105324c 2023-11-11 04:54:09,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/44b0ed01e9df4dde9e01d69e7abc5dc0 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/44b0ed01e9df4dde9e01d69e7abc5dc0 2023-11-11 04:54:09,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/41bc866b5ebd4fbabe6a97ba6ffbdba1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/41bc866b5ebd4fbabe6a97ba6ffbdba1 2023-11-11 04:54:09,333 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 56b66f90356641deea4e629f16f10396#family1#compaction#35 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:54:09,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/c0dd8db4e90240fba9734d1e51a9f6c1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/c0dd8db4e90240fba9734d1e51a9f6c1 2023-11-11 04:54:09,344 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ff8b6d2e82834f4bbea9ffc1b2494dab to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ff8b6d2e82834f4bbea9ffc1b2494dab 2023-11-11 04:54:09,346 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/abb0bfd52b3b47409f0ee483a475bdfc to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/abb0bfd52b3b47409f0ee483a475bdfc 2023-11-11 04:54:09,348 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/97589dd66613495cbfc93aaa2d6b67c8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/97589dd66613495cbfc93aaa2d6b67c8 2023-11-11 04:54:09,349 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/52398f8590034b98a780652708177ceb to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/52398f8590034b98a780652708177ceb 2023-11-11 04:54:09,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/33056a3ce32d42a79c1694e861abd75c_SeqId_44_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/33056a3ce32d42a79c1694e861abd75c_SeqId_44_ 2023-11-11 04:54:09,358 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-11-11 04:54:09,421 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=264 (was 260) - Thread LEAK? -, OpenFileDescriptor=641 (was 641), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 223), ProcessCount=169 (was 169), AvailableMemoryMB=2095 (was 2115) 2023-11-11 04:54:09,432 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=264, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=181, ProcessCount=169, AvailableMemoryMB=2094 2023-11-11 04:54:09,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-11 04:54:09,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:09,437 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:54:09,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-11 04:54:09,437 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:54:09,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 04:54:09,439 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testScannerOnBulkLoadRefHFiles/00839ddd2f9a872eed900d298a42d55d 2023-11-11 04:54:09,439 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:54:09,440 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76 2023-11-11 04:54:09,440 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testScannerOnBulkLoadRefHFiles/00839ddd2f9a872eed900d298a42d55d empty. 2023-11-11 04:54:09,440 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76 empty. 2023-11-11 04:54:09,440 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7ad6e1bf3c142f58e3a8231f44a6cb3e empty. 2023-11-11 04:54:09,441 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testScannerOnBulkLoadRefHFiles/00839ddd2f9a872eed900d298a42d55d 2023-11-11 04:54:09,441 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76 2023-11-11 04:54:09,441 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:54:09,441 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-11 04:54:09,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 04:54:09,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 04:54:09,852 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-11 04:54:09,854 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 00839ddd2f9a872eed900d298a42d55d, NAME => 'testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:54:09,854 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 1373b9c69a7c6eb51a25925a8d2f6a76, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:54:09,854 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7ad6e1bf3c142f58e3a8231f44a6cb3e, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:54:10,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 04:54:10,264 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:10,264 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:10,265 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 00839ddd2f9a872eed900d298a42d55d, disabling compactions & flushes 2023-11-11 04:54:10,265 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 1373b9c69a7c6eb51a25925a8d2f6a76, disabling compactions & flushes 2023-11-11 04:54:10,265 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:54:10,265 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:54:10,265 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:10,265 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. after waiting 0 ms 2023-11-11 04:54:10,265 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:54:10,265 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:10,265 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:54:10,265 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. after waiting 0 ms 2023-11-11 04:54:10,265 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:10,265 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:10,265 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 1373b9c69a7c6eb51a25925a8d2f6a76: 2023-11-11 04:54:10,265 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 00839ddd2f9a872eed900d298a42d55d: 2023-11-11 04:54:10,266 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:10,266 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 7ad6e1bf3c142f58e3a8231f44a6cb3e, disabling compactions & flushes 2023-11-11 04:54:10,266 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:54:10,266 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:54:10,266 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. after waiting 0 ms 2023-11-11 04:54:10,266 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:54:10,266 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:54:10,266 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 7ad6e1bf3c142f58e3a8231f44a6cb3e: 2023-11-11 04:54:10,269 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:54:10,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699678450270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678450270"}]},"ts":"1699678450270"} 2023-11-11 04:54:10,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699678450270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678450270"}]},"ts":"1699678450270"} 2023-11-11 04:54:10,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699678450270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678450270"}]},"ts":"1699678450270"} 2023-11-11 04:54:10,273 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-11 04:54:10,274 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:54:10,274 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678450274"}]},"ts":"1699678450274"} 2023-11-11 04:54:10,275 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-11 04:54:10,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=00839ddd2f9a872eed900d298a42d55d, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7ad6e1bf3c142f58e3a8231f44a6cb3e, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1373b9c69a7c6eb51a25925a8d2f6a76, ASSIGN}] 2023-11-11 04:54:10,281 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7ad6e1bf3c142f58e3a8231f44a6cb3e, ASSIGN 2023-11-11 04:54:10,281 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1373b9c69a7c6eb51a25925a8d2f6a76, ASSIGN 2023-11-11 04:54:10,282 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=00839ddd2f9a872eed900d298a42d55d, ASSIGN 2023-11-11 04:54:10,282 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7ad6e1bf3c142f58e3a8231f44a6cb3e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:54:10,282 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1373b9c69a7c6eb51a25925a8d2f6a76, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:54:10,282 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=00839ddd2f9a872eed900d298a42d55d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:54:10,434 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7ad6e1bf3c142f58e3a8231f44a6cb3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:10,434 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=1373b9c69a7c6eb51a25925a8d2f6a76, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:10,434 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=00839ddd2f9a872eed900d298a42d55d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:10,434 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699678450434"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678450434"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678450434"}]},"ts":"1699678450434"} 2023-11-11 04:54:10,434 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699678450434"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678450434"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678450434"}]},"ts":"1699678450434"} 2023-11-11 04:54:10,434 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699678450434"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678450434"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678450434"}]},"ts":"1699678450434"} 2023-11-11 04:54:10,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 7ad6e1bf3c142f58e3a8231f44a6cb3e, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:10,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 1373b9c69a7c6eb51a25925a8d2f6a76, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:10,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 00839ddd2f9a872eed900d298a42d55d, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:10,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 04:54:10,566 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/.tmp/family1/d88850852bba4f48a77de9b855943be5 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/d88850852bba4f48a77de9b855943be5 2023-11-11 04:54:10,571 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 56b66f90356641deea4e629f16f10396/family1 of 56b66f90356641deea4e629f16f10396 into d88850852bba4f48a77de9b855943be5(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:54:10,571 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:54:10,571 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1699678449305; duration=1sec 2023-11-11 04:54:10,571 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:10,588 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:10,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:54:10,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ad6e1bf3c142f58e3a8231f44a6cb3e, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e.', STARTKEY => '1', ENDKEY => '2'} 2023-11-11 04:54:10,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:54:10,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:10,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:54:10,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:54:10,592 INFO [StoreOpener-7ad6e1bf3c142f58e3a8231f44a6cb3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:54:10,594 DEBUG [StoreOpener-7ad6e1bf3c142f58e3a8231f44a6cb3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/7ad6e1bf3c142f58e3a8231f44a6cb3e/family1 2023-11-11 04:54:10,594 DEBUG [StoreOpener-7ad6e1bf3c142f58e3a8231f44a6cb3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/7ad6e1bf3c142f58e3a8231f44a6cb3e/family1 2023-11-11 04:54:10,594 INFO [StoreOpener-7ad6e1bf3c142f58e3a8231f44a6cb3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ad6e1bf3c142f58e3a8231f44a6cb3e columnFamilyName family1 2023-11-11 04:54:10,596 INFO [StoreOpener-7ad6e1bf3c142f58e3a8231f44a6cb3e-1] regionserver.HStore(310): Store=7ad6e1bf3c142f58e3a8231f44a6cb3e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:10,596 INFO [StoreOpener-7ad6e1bf3c142f58e3a8231f44a6cb3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:54:10,597 DEBUG [StoreOpener-7ad6e1bf3c142f58e3a8231f44a6cb3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/7ad6e1bf3c142f58e3a8231f44a6cb3e/family2 2023-11-11 04:54:10,597 DEBUG [StoreOpener-7ad6e1bf3c142f58e3a8231f44a6cb3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/7ad6e1bf3c142f58e3a8231f44a6cb3e/family2 2023-11-11 04:54:10,598 INFO [StoreOpener-7ad6e1bf3c142f58e3a8231f44a6cb3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ad6e1bf3c142f58e3a8231f44a6cb3e columnFamilyName family2 2023-11-11 04:54:10,599 INFO [StoreOpener-7ad6e1bf3c142f58e3a8231f44a6cb3e-1] regionserver.HStore(310): Store=7ad6e1bf3c142f58e3a8231f44a6cb3e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:10,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:54:10,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:54:10,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:54:10,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:54:10,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/7ad6e1bf3c142f58e3a8231f44a6cb3e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:54:10,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ad6e1bf3c142f58e3a8231f44a6cb3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62606816, jitterRate=-0.06708574295043945}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:54:10,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ad6e1bf3c142f58e3a8231f44a6cb3e: 2023-11-11 04:54:10,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e., pid=31, masterSystemTime=1699678450588 2023-11-11 04:54:10,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:54:10,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:54:10,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:54:10,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 00839ddd2f9a872eed900d298a42d55d, NAME => 'testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d.', STARTKEY => '', ENDKEY => '1'} 2023-11-11 04:54:10,608 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7ad6e1bf3c142f58e3a8231f44a6cb3e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:10,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 00839ddd2f9a872eed900d298a42d55d 2023-11-11 04:54:10,608 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699678450608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678450608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678450608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678450608"}]},"ts":"1699678450608"} 2023-11-11 04:54:10,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:10,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 00839ddd2f9a872eed900d298a42d55d 2023-11-11 04:54:10,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 00839ddd2f9a872eed900d298a42d55d 2023-11-11 04:54:10,610 INFO [StoreOpener-00839ddd2f9a872eed900d298a42d55d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 00839ddd2f9a872eed900d298a42d55d 2023-11-11 04:54:10,611 DEBUG [StoreOpener-00839ddd2f9a872eed900d298a42d55d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/00839ddd2f9a872eed900d298a42d55d/family1 2023-11-11 04:54:10,611 DEBUG [StoreOpener-00839ddd2f9a872eed900d298a42d55d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/00839ddd2f9a872eed900d298a42d55d/family1 2023-11-11 04:54:10,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-11-11 04:54:10,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 7ad6e1bf3c142f58e3a8231f44a6cb3e, server=jenkins-hbase4.apache.org,43941,1699678403879 in 174 msec 2023-11-11 04:54:10,612 INFO [StoreOpener-00839ddd2f9a872eed900d298a42d55d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00839ddd2f9a872eed900d298a42d55d columnFamilyName family1 2023-11-11 04:54:10,612 INFO [StoreOpener-00839ddd2f9a872eed900d298a42d55d-1] regionserver.HStore(310): Store=00839ddd2f9a872eed900d298a42d55d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:10,613 INFO [StoreOpener-00839ddd2f9a872eed900d298a42d55d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 00839ddd2f9a872eed900d298a42d55d 2023-11-11 04:54:10,613 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7ad6e1bf3c142f58e3a8231f44a6cb3e, ASSIGN in 331 msec 2023-11-11 04:54:10,614 DEBUG [StoreOpener-00839ddd2f9a872eed900d298a42d55d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/00839ddd2f9a872eed900d298a42d55d/family2 2023-11-11 04:54:10,614 DEBUG [StoreOpener-00839ddd2f9a872eed900d298a42d55d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/00839ddd2f9a872eed900d298a42d55d/family2 2023-11-11 04:54:10,615 INFO [StoreOpener-00839ddd2f9a872eed900d298a42d55d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00839ddd2f9a872eed900d298a42d55d columnFamilyName family2 2023-11-11 04:54:10,616 INFO [StoreOpener-00839ddd2f9a872eed900d298a42d55d-1] regionserver.HStore(310): Store=00839ddd2f9a872eed900d298a42d55d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:10,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/00839ddd2f9a872eed900d298a42d55d 2023-11-11 04:54:10,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/00839ddd2f9a872eed900d298a42d55d 2023-11-11 04:54:10,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:54:10,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 00839ddd2f9a872eed900d298a42d55d 2023-11-11 04:54:10,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/00839ddd2f9a872eed900d298a42d55d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:54:10,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 00839ddd2f9a872eed900d298a42d55d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66202208, jitterRate=-0.01351022720336914}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:54:10,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 00839ddd2f9a872eed900d298a42d55d: 2023-11-11 04:54:10,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d., pid=33, masterSystemTime=1699678450588 2023-11-11 04:54:10,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/0dcc6e2dbad648d89b1fd7ff886f22e1, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/643c8a884fd843fe9866e225ca07db85, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ec7120e9a3bd49688c212fbb7d7a4509_SeqId_47_] to archive 2023-11-11 04:54:10,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:10,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:54:10,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:54:10,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:10,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1373b9c69a7c6eb51a25925a8d2f6a76, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76.', STARTKEY => '2', ENDKEY => ''} 2023-11-11 04:54:10,629 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=00839ddd2f9a872eed900d298a42d55d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:10,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 1373b9c69a7c6eb51a25925a8d2f6a76 2023-11-11 04:54:10,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:10,629 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699678450629"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678450629"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678450629"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678450629"}]},"ts":"1699678450629"} 2023-11-11 04:54:10,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1373b9c69a7c6eb51a25925a8d2f6a76 2023-11-11 04:54:10,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1373b9c69a7c6eb51a25925a8d2f6a76 2023-11-11 04:54:10,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/0dcc6e2dbad648d89b1fd7ff886f22e1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/0dcc6e2dbad648d89b1fd7ff886f22e1 2023-11-11 04:54:10,631 INFO [StoreOpener-1373b9c69a7c6eb51a25925a8d2f6a76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1373b9c69a7c6eb51a25925a8d2f6a76 2023-11-11 04:54:10,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/643c8a884fd843fe9866e225ca07db85 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/643c8a884fd843fe9866e225ca07db85 2023-11-11 04:54:10,633 DEBUG [StoreOpener-1373b9c69a7c6eb51a25925a8d2f6a76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1 2023-11-11 04:54:10,633 DEBUG [StoreOpener-1373b9c69a7c6eb51a25925a8d2f6a76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1 2023-11-11 04:54:10,633 INFO [StoreOpener-1373b9c69a7c6eb51a25925a8d2f6a76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1373b9c69a7c6eb51a25925a8d2f6a76 columnFamilyName family1 2023-11-11 04:54:10,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=28 2023-11-11 04:54:10,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 00839ddd2f9a872eed900d298a42d55d, server=jenkins-hbase4.apache.org,43941,1699678403879 in 194 msec 2023-11-11 04:54:10,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ec7120e9a3bd49688c212fbb7d7a4509_SeqId_47_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/family1/ec7120e9a3bd49688c212fbb7d7a4509_SeqId_47_ 2023-11-11 04:54:10,635 INFO [StoreOpener-1373b9c69a7c6eb51a25925a8d2f6a76-1] regionserver.HStore(310): Store=1373b9c69a7c6eb51a25925a8d2f6a76/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:10,635 INFO [StoreOpener-1373b9c69a7c6eb51a25925a8d2f6a76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1373b9c69a7c6eb51a25925a8d2f6a76 2023-11-11 04:54:10,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=00839ddd2f9a872eed900d298a42d55d, ASSIGN in 353 msec 2023-11-11 04:54:10,636 DEBUG [StoreOpener-1373b9c69a7c6eb51a25925a8d2f6a76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family2 2023-11-11 04:54:10,636 DEBUG [StoreOpener-1373b9c69a7c6eb51a25925a8d2f6a76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family2 2023-11-11 04:54:10,637 INFO [StoreOpener-1373b9c69a7c6eb51a25925a8d2f6a76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1373b9c69a7c6eb51a25925a8d2f6a76 columnFamilyName family2 2023-11-11 04:54:10,638 INFO [StoreOpener-1373b9c69a7c6eb51a25925a8d2f6a76-1] regionserver.HStore(310): Store=1373b9c69a7c6eb51a25925a8d2f6a76/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:10,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76 2023-11-11 04:54:10,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76 2023-11-11 04:54:10,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:54:10,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1373b9c69a7c6eb51a25925a8d2f6a76 2023-11-11 04:54:10,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:54:10,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1373b9c69a7c6eb51a25925a8d2f6a76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63917399, jitterRate=-0.04755653440952301}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:54:10,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1373b9c69a7c6eb51a25925a8d2f6a76: 2023-11-11 04:54:10,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76., pid=32, masterSystemTime=1699678450588 2023-11-11 04:54:10,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:10,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:10,648 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=1373b9c69a7c6eb51a25925a8d2f6a76, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:10,648 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699678450648"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678450648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678450648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678450648"}]},"ts":"1699678450648"} 2023-11-11 04:54:10,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=30 2023-11-11 04:54:10,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 1373b9c69a7c6eb51a25925a8d2f6a76, server=jenkins-hbase4.apache.org,43941,1699678403879 in 213 msec 2023-11-11 04:54:10,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=27 2023-11-11 04:54:10,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1373b9c69a7c6eb51a25925a8d2f6a76, ASSIGN in 371 msec 2023-11-11 04:54:10,654 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:54:10,654 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678450654"}]},"ts":"1699678450654"} 2023-11-11 04:54:10,655 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-11 04:54:10,658 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:54:10,659 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2240 sec 2023-11-11 04:54:11,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 04:54:11,543 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-11 04:54:11,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:11,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:11,552 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-11 04:54:11,552 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:11,552 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-11 04:54:11,552 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-11 04:54:11,553 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:11,553 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:11,562 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:11,562 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:11,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:11,562 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:11,562 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:11,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:11,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:11,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:11,563 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:11,563 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-11 04:54:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-11 04:54:11,564 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:54:11,564 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. started... 2023-11-11 04:54:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:54:11,564 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:11,565 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7ad6e1bf3c142f58e3a8231f44a6cb3e: 2023-11-11 04:54:11,565 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:54:11,564 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:11,565 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. started... 2023-11-11 04:54:11,565 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:54:11,565 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. started... 2023-11-11 04:54:11,566 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:54:11,566 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 00839ddd2f9a872eed900d298a42d55d: 2023-11-11 04:54:11,566 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1373b9c69a7c6eb51a25925a8d2f6a76 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-11 04:54:11,566 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:54:11,566 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:54:11,982 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111f926b3a41ab54f228bebab3edb90493d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231111f926b3a41ab54f228bebab3edb90493d 2023-11-11 04:54:12,388 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/.tmp/family1/91938c165c384e0da3656b5e168efc2e 2023-11-11 04:54:12,393 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/.tmp/family1/91938c165c384e0da3656b5e168efc2e as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/91938c165c384e0da3656b5e168efc2e 2023-11-11 04:54:12,398 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/91938c165c384e0da3656b5e168efc2e, entries=1, sequenceid=5, filesize=4.9 K 2023-11-11 04:54:12,398 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 1373b9c69a7c6eb51a25925a8d2f6a76 in 832ms, sequenceid=5, compaction requested=false 2023-11-11 04:54:12,399 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-11 04:54:12,399 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1373b9c69a7c6eb51a25925a8d2f6a76: 2023-11-11 04:54:12,399 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:12,399 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:54:12,399 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:54:12,399 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,399 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-11 04:54:12,399 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-11 04:54:12,401 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,401 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:12,401 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,401 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:12,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-11 04:54:12,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@208252a8[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:12,403 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-11 04:54:12,403 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,404 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,405 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-11 04:54:12,405 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-11 04:54:12,405 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,405 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:12,405 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:12,407 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,407 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-11 04:54:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:12,407 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:12,407 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-11 04:54:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:12,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:12,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:12,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-11 04:54:12,409 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-11 04:54:12,409 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:12,409 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:12,410 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,410 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:12,412 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,412 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:12,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:12,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,413 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:12,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:12,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:12,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:12,413 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:12,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,415 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:12,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,418 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,418 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:12,418 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,418 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:12,418 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-11 04:54:12,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:12,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:12,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:12,418 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:12,418 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,418 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,418 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:12,418 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,418 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:12,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:12,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:12,418 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,519 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:12,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:12,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:12,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:12,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,525 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-11 04:54:12,525 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:12,525 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-11 04:54:12,525 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-11 04:54:12,526 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,526 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,527 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:12,527 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:12,528 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,528 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:12,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,528 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,528 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-11 04:54:12,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,529 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-11 04:54:12,529 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:12,529 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-11 04:54:12,529 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:54:12,529 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. started... 2023-11-11 04:54:12,529 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:12,529 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. started... 2023-11-11 04:54:12,529 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7ad6e1bf3c142f58e3a8231f44a6cb3e: 2023-11-11 04:54:12,529 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1373b9c69a7c6eb51a25925a8d2f6a76 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-11 04:54:12,529 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:54:12,530 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:54:12,530 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:12,530 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:54:12,530 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:54:12,530 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. started... 2023-11-11 04:54:12,530 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 00839ddd2f9a872eed900d298a42d55d: 2023-11-11 04:54:12,530 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:54:12,530 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:54:12,944 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311117841a2efb535422fa03daa1cc3e5056f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311117841a2efb535422fa03daa1cc3e5056f 2023-11-11 04:54:12,949 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/.tmp/family1/92a581ad8ef54b5fbd8da64b7b1811fc 2023-11-11 04:54:12,954 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/.tmp/family1/92a581ad8ef54b5fbd8da64b7b1811fc as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/92a581ad8ef54b5fbd8da64b7b1811fc 2023-11-11 04:54:12,958 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/92a581ad8ef54b5fbd8da64b7b1811fc, entries=2, sequenceid=9, filesize=5.0 K 2023-11-11 04:54:12,959 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 1373b9c69a7c6eb51a25925a8d2f6a76 in 430ms, sequenceid=9, compaction requested=false 2023-11-11 04:54:12,959 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1373b9c69a7c6eb51a25925a8d2f6a76: 2023-11-11 04:54:12,959 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:12,959 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:54:12,959 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:54:12,959 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,959 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-11 04:54:12,959 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-11 04:54:12,961 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,961 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:12,961 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,961 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:12,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:12,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:12,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:12,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-11 04:54:12,963 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-11 04:54:12,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fb7b081[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:12,963 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,965 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-11 04:54:12,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-11 04:54:12,965 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,966 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:12,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:12,967 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-11 04:54:12,967 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,967 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:12,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:12,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:12,967 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-11 04:54:12,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:12,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:12,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:12,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-11 04:54:12,970 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-11 04:54:12,970 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:12,970 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:12,970 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,970 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:12,971 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,971 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:12,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:12,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,971 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:12,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:12,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:12,972 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:12,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,973 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,980 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,980 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:12,980 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:12,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-11 04:54:12,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:12,980 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:12,980 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,980 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:12,980 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:12,980 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,980 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:12,981 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:12,980 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,981 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:12,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:13,081 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:13,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:13,088 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-11 04:54:13,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-11 04:54:13,091 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-11 04:54:13,092 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679053092 2023-11-11 04:54:13,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:13,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:54:13,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-11 04:54:13,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-11 04:54:13,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x578400cf to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:54:13,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7567900f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:54:13,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231111 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-11 04:54:13,926 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111997fe3273f924336bba9de31f06aa1d8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231111997fe3273f924336bba9de31f06aa1d8 2023-11-11 04:54:13,927 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-11 04:54:13,941 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:54:13,942 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:54:13,949 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:54:13,951 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:54:13,960 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231111/family1/9362309337e748c2ace1f00684c3e2af first=Optional[k0] last=Optional[k1] 2023-11-11 04:54:13,961 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231111/family1/9362309337e748c2ace1f00684c3e2af}] 2023-11-11 04:54:13,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231111/family1/9362309337e748c2ace1f00684c3e2af for inclusion in 1373b9c69a7c6eb51a25925a8d2f6a76/family1 2023-11-11 04:54:13,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-11 04:54:13,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-11 04:54:13,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 1373b9c69a7c6eb51a25925a8d2f6a76: 2023-11-11 04:54:13,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231111/family1/9362309337e748c2ace1f00684c3e2af to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testScannerOnBulkLoadRefHFiles__b4gn0kcfganilf32i5atd6o3kstfn0k5sjbljr19aveeae1k97b8r8ru1dfk1cee/family1/9362309337e748c2ace1f00684c3e2af 2023-11-11 04:54:13,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testScannerOnBulkLoadRefHFiles__b4gn0kcfganilf32i5atd6o3kstfn0k5sjbljr19aveeae1k97b8r8ru1dfk1cee/family1/9362309337e748c2ace1f00684c3e2af as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/7d292ac2c3754bfba87811c85888370a_SeqId_12_ 2023-11-11 04:54:13,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testScannerOnBulkLoadRefHFiles__b4gn0kcfganilf32i5atd6o3kstfn0k5sjbljr19aveeae1k97b8r8ru1dfk1cee/family1/9362309337e748c2ace1f00684c3e2af into 1373b9c69a7c6eb51a25925a8d2f6a76/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/7d292ac2c3754bfba87811c85888370a_SeqId_12_ - updating store file list. 2023-11-11 04:54:13,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/7d292ac2c3754bfba87811c85888370a_SeqId_12_ into 1373b9c69a7c6eb51a25925a8d2f6a76/family1 2023-11-11 04:54:13,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testScannerOnBulkLoadRefHFiles__b4gn0kcfganilf32i5atd6o3kstfn0k5sjbljr19aveeae1k97b8r8ru1dfk1cee/family1/9362309337e748c2ace1f00684c3e2af into 1373b9c69a7c6eb51a25925a8d2f6a76/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/7d292ac2c3754bfba87811c85888370a_SeqId_12_) 2023-11-11 04:54:13,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testScannerOnBulkLoadRefHFiles__b4gn0kcfganilf32i5atd6o3kstfn0k5sjbljr19aveeae1k97b8r8ru1dfk1cee/family1/9362309337e748c2ace1f00684c3e2af 2023-11-11 04:54:13,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 04:54:13,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 04:54:13,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): 1373b9c69a7c6eb51a25925a8d2f6a76/family1 is initiating minor compaction (all files) 2023-11-11 04:54:13,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2fa4de3a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:13,978 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1373b9c69a7c6eb51a25925a8d2f6a76/family1 in testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:54:13,978 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/91938c165c384e0da3656b5e168efc2e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/92a581ad8ef54b5fbd8da64b7b1811fc, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/7d292ac2c3754bfba87811c85888370a_SeqId_12_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/.tmp, totalSize=15.1 K 2023-11-11 04:54:13,979 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 91938c165c384e0da3656b5e168efc2e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678451543 2023-11-11 04:54:13,979 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 92a581ad8ef54b5fbd8da64b7b1811fc, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678451543 2023-11-11 04:54:13,980 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 7d292ac2c3754bfba87811c85888370a_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678451543 2023-11-11 04:54:13,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-11 04:54:13,981 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:13,982 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311117841a2efb535422fa03daa1cc3e5056f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311117841a2efb535422fa03daa1cc3e5056f 2023-11-11 04:54:13,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231111f926b3a41ab54f228bebab3edb90493d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231111f926b3a41ab54f228bebab3edb90493d 2023-11-11 04:54:13,984 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-11 04:54:13,984 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231111' 2023-11-11 04:54:13,984 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231111 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-11 04:54:13,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-11 04:54:13,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:13,985 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-11 04:54:13,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 897 msec 2023-11-11 04:54:13,997 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1373b9c69a7c6eb51a25925a8d2f6a76#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:54:14,023 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=262 (was 264), OpenFileDescriptor=654 (was 641) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=175 (was 181), ProcessCount=169 (was 169), AvailableMemoryMB=2072 (was 2094) 2023-11-11 04:54:14,034 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=262, OpenFileDescriptor=654, MaxFileDescriptor=60000, SystemLoadAverage=175, ProcessCount=169, AvailableMemoryMB=2071 2023-11-11 04:54:14,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 04:54:14,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:14,039 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:54:14,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-11 04:54:14,039 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:54:14,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-11 04:54:14,040 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7 2023-11-11 04:54:14,041 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7 empty. 2023-11-11 04:54:14,041 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7 2023-11-11 04:54:14,041 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-11 04:54:14,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-11 04:54:14,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-11 04:54:14,449 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-11 04:54:14,450 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1c2f996c60d38ae9ae3e9427d010ada7, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:54:14,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-11 04:54:14,856 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:14,856 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 1c2f996c60d38ae9ae3e9427d010ada7, disabling compactions & flushes 2023-11-11 04:54:14,856 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:14,856 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:14,856 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. after waiting 0 ms 2023-11-11 04:54:14,856 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:14,856 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:14,856 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:14,858 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:54:14,859 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699678454859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678454859"}]},"ts":"1699678454859"} 2023-11-11 04:54:14,861 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 04:54:14,861 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:54:14,862 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678454862"}]},"ts":"1699678454862"} 2023-11-11 04:54:14,863 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-11 04:54:14,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=1c2f996c60d38ae9ae3e9427d010ada7, ASSIGN}] 2023-11-11 04:54:14,869 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=1c2f996c60d38ae9ae3e9427d010ada7, ASSIGN 2023-11-11 04:54:14,869 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=1c2f996c60d38ae9ae3e9427d010ada7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:54:15,020 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=1c2f996c60d38ae9ae3e9427d010ada7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:15,020 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699678455020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678455020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678455020"}]},"ts":"1699678455020"} 2023-11-11 04:54:15,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 1c2f996c60d38ae9ae3e9427d010ada7, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:15,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-11 04:54:15,174 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:15,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:15,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c2f996c60d38ae9ae3e9427d010ada7, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:54:15,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 1c2f996c60d38ae9ae3e9427d010ada7 2023-11-11 04:54:15,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:15,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1c2f996c60d38ae9ae3e9427d010ada7 2023-11-11 04:54:15,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1c2f996c60d38ae9ae3e9427d010ada7 2023-11-11 04:54:15,178 INFO [StoreOpener-1c2f996c60d38ae9ae3e9427d010ada7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1c2f996c60d38ae9ae3e9427d010ada7 2023-11-11 04:54:15,180 DEBUG [StoreOpener-1c2f996c60d38ae9ae3e9427d010ada7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1 2023-11-11 04:54:15,180 DEBUG [StoreOpener-1c2f996c60d38ae9ae3e9427d010ada7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1 2023-11-11 04:54:15,180 INFO [StoreOpener-1c2f996c60d38ae9ae3e9427d010ada7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c2f996c60d38ae9ae3e9427d010ada7 columnFamilyName family1 2023-11-11 04:54:15,182 INFO [StoreOpener-1c2f996c60d38ae9ae3e9427d010ada7-1] regionserver.HStore(310): Store=1c2f996c60d38ae9ae3e9427d010ada7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:15,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7 2023-11-11 04:54:15,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7 2023-11-11 04:54:15,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1c2f996c60d38ae9ae3e9427d010ada7 2023-11-11 04:54:15,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:54:15,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1c2f996c60d38ae9ae3e9427d010ada7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75019129, jitterRate=0.11787213385105133}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:54:15,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:15,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7., pid=37, masterSystemTime=1699678455174 2023-11-11 04:54:15,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:15,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:15,191 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=1c2f996c60d38ae9ae3e9427d010ada7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:15,192 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699678455191"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678455191"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678455191"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678455191"}]},"ts":"1699678455191"} 2023-11-11 04:54:15,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-11 04:54:15,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 1c2f996c60d38ae9ae3e9427d010ada7, server=jenkins-hbase4.apache.org,43941,1699678403879 in 171 msec 2023-11-11 04:54:15,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-11 04:54:15,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=1c2f996c60d38ae9ae3e9427d010ada7, ASSIGN in 328 msec 2023-11-11 04:54:15,198 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:54:15,198 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678455198"}]},"ts":"1699678455198"} 2023-11-11 04:54:15,199 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-11 04:54:15,201 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:54:15,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1650 sec 2023-11-11 04:54:15,216 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/.tmp/family1/4caaafb554454297b6dacf5b50a25d7d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/4caaafb554454297b6dacf5b50a25d7d 2023-11-11 04:54:15,221 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1373b9c69a7c6eb51a25925a8d2f6a76/family1 of 1373b9c69a7c6eb51a25925a8d2f6a76 into 4caaafb554454297b6dacf5b50a25d7d(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:54:15,221 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1373b9c69a7c6eb51a25925a8d2f6a76: 2023-11-11 04:54:15,222 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1699678453978; duration=1sec 2023-11-11 04:54:15,222 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:15,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/91938c165c384e0da3656b5e168efc2e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/92a581ad8ef54b5fbd8da64b7b1811fc, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/7d292ac2c3754bfba87811c85888370a_SeqId_12_] to archive 2023-11-11 04:54:15,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:15,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/91938c165c384e0da3656b5e168efc2e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/91938c165c384e0da3656b5e168efc2e 2023-11-11 04:54:15,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/92a581ad8ef54b5fbd8da64b7b1811fc to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/92a581ad8ef54b5fbd8da64b7b1811fc 2023-11-11 04:54:15,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/7d292ac2c3754bfba87811c85888370a_SeqId_12_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/family1/7d292ac2c3754bfba87811c85888370a_SeqId_12_ 2023-11-11 04:54:16,120 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:54:16,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-11 04:54:16,144 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-11 04:54:16,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:16,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:16,168 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:16,168 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:16,168 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:16,168 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:16,168 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:16,168 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:16,170 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:16,170 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:16,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:16,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:16,170 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:16,170 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:16,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:16,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:16,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:16,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:16,171 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:16,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:16,171 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:16,171 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:16,172 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:16,172 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:16,172 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:16,172 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:16,172 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. started... 2023-11-11 04:54:16,172 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c2f996c60d38ae9ae3e9427d010ada7 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 04:54:16,591 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113030dba189978c47e4be9171dc5a593761 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113030dba189978c47e4be9171dc5a593761 2023-11-11 04:54:16,995 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/fe05ef95b2bb4f24a86d6427b66c8816 2023-11-11 04:54:17,000 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/fe05ef95b2bb4f24a86d6427b66c8816 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/fe05ef95b2bb4f24a86d6427b66c8816 2023-11-11 04:54:17,005 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/fe05ef95b2bb4f24a86d6427b66c8816, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-11 04:54:17,005 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1c2f996c60d38ae9ae3e9427d010ada7 in 833ms, sequenceid=5, compaction requested=false 2023-11-11 04:54:17,005 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:17,006 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:17,006 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:17,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:17,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:17,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:17,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:17,008 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,008 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:17,008 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,008 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:17,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:17,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:17,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d77fdb8[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:17,010 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:17,010 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,012 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:17,013 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:17,013 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:17,013 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,013 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:17,014 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:17,014 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:17,014 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,014 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:17,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:17,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:17,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:17,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:17,017 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:17,017 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:17,017 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:17,017 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,017 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:17,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:17,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:17,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:17,019 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,020 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:17,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:17,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:17,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:17,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:17,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:17,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:17,023 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:17,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:17,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:17,023 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:17,024 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:17,124 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:17,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:17,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:17,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:17,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,130 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:17,130 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:17,130 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:17,130 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:17,131 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,131 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,133 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,133 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:17,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:17,133 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,133 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:17,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,134 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,134 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:17,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,134 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:17,134 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:17,134 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:17,134 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:17,134 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:17,134 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:17,134 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. started... 2023-11-11 04:54:17,134 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c2f996c60d38ae9ae3e9427d010ada7 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 04:54:17,547 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112879220861c5bd4f80af7da66a29877c0e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112879220861c5bd4f80af7da66a29877c0e 2023-11-11 04:54:17,953 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/45ba1bb48b5b462ea445a87a2422f8b6 2023-11-11 04:54:17,958 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/45ba1bb48b5b462ea445a87a2422f8b6 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/45ba1bb48b5b462ea445a87a2422f8b6 2023-11-11 04:54:17,962 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/45ba1bb48b5b462ea445a87a2422f8b6, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 04:54:17,963 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1c2f996c60d38ae9ae3e9427d010ada7 in 829ms, sequenceid=9, compaction requested=false 2023-11-11 04:54:17,963 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:17,963 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:17,963 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:17,963 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:17,963 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,963 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:17,963 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:17,965 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:17,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:17,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:17,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:17,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:17,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:17,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40f686f9[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:17,967 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:17,967 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,968 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,968 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:17,968 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:17,968 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:17,968 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,968 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:17,969 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:17,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:17,972 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:17,972 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:17,972 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:17,972 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,972 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:17,974 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,974 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,974 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:17,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:17,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:17,975 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,976 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,978 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,978 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:17,978 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:17,979 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,979 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:17,979 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:17,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:17,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:17,979 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:17,979 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,979 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,979 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:17,979 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:17,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:17,979 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:18,079 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:18,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:18,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:18,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:18,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,086 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:18,086 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:18,086 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:18,086 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:18,086 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,086 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,090 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,090 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:18,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:18,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:18,090 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,090 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:18,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:18,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,092 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,092 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:18,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,092 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:18,092 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:18,092 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:18,092 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:18,092 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:18,092 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:18,092 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. started... 2023-11-11 04:54:18,092 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c2f996c60d38ae9ae3e9427d010ada7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:18,504 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201616221d512ca413aaaea98dcec0cbf20 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201616221d512ca413aaaea98dcec0cbf20 2023-11-11 04:54:18,910 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/ae5ac79135ab4fe282328971db8f3b93 2023-11-11 04:54:18,915 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/ae5ac79135ab4fe282328971db8f3b93 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/ae5ac79135ab4fe282328971db8f3b93 2023-11-11 04:54:18,919 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/ae5ac79135ab4fe282328971db8f3b93, entries=1, sequenceid=13, filesize=4.9 K 2023-11-11 04:54:18,920 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c2f996c60d38ae9ae3e9427d010ada7 in 828ms, sequenceid=13, compaction requested=true 2023-11-11 04:54:18,920 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:18,920 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:18,922 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,922 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:18,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:18,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:18,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72d39b5d[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:18,924 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:18,924 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,925 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,925 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:18,925 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:18,925 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:18,925 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,925 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:18,928 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:18,928 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:18,928 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,928 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:18,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:18,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:18,930 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:18,930 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:18,930 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:18,930 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,930 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:18,932 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,932 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,932 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:18,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:18,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,933 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:18,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,934 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:18,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:18,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:18,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:18,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:18,936 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:18,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:18,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:18,937 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:18,937 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,937 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:18,937 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:18,937 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:18,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:19,037 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:19,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:19,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:19,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:19,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,043 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:19,043 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:19,043 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:19,043 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:19,044 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,044 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,045 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:19,045 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:19,045 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,045 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:19,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,046 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,046 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:19,046 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,046 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:19,046 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:19,046 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:19,047 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:19,047 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:19,047 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:19,047 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. started... 2023-11-11 04:54:19,047 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c2f996c60d38ae9ae3e9427d010ada7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:19,459 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b3736e65a11e48bd938b78ece2cd1f36 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b3736e65a11e48bd938b78ece2cd1f36 2023-11-11 04:54:19,865 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/e1a5afadd4cf4086822ea3c55adf7cee 2023-11-11 04:54:19,869 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/e1a5afadd4cf4086822ea3c55adf7cee as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/e1a5afadd4cf4086822ea3c55adf7cee 2023-11-11 04:54:19,874 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/e1a5afadd4cf4086822ea3c55adf7cee, entries=1, sequenceid=17, filesize=4.9 K 2023-11-11 04:54:19,874 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c2f996c60d38ae9ae3e9427d010ada7 in 827ms, sequenceid=17, compaction requested=true 2023-11-11 04:54:19,874 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:19,875 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:19,875 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:19,875 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:19,875 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,875 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:19,875 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:19,878 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,878 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:19,878 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,878 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:19,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:19,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70e20e3e[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:19,880 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:19,880 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,881 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,881 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:19,881 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:19,881 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:19,881 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,881 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:19,882 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:19,882 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,882 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,883 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:19,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:19,885 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:19,885 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:19,885 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:19,885 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,885 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:19,887 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,887 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:19,887 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:19,887 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,889 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,892 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,892 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,892 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:19,892 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:19,892 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:19,892 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:19,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:19,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:19,892 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:19,892 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,892 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,892 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:19,892 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:19,893 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:19,993 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:19,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:19,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:19,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:19,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,999 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:19,999 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:19,999 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:19,999 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:19,999 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:19,999 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,001 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,001 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:20,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:20,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:20,001 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,001 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:20,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:20,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,002 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,002 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:20,002 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,002 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:20,002 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:20,002 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:20,002 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:20,002 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:20,003 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:20,003 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. started... 2023-11-11 04:54:20,003 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c2f996c60d38ae9ae3e9427d010ada7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:20,415 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228acd52384431442138d41a290c3f408c8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228acd52384431442138d41a290c3f408c8 2023-11-11 04:54:20,821 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/7024d8b19bc1460692bbabc46943f297 2023-11-11 04:54:20,826 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/7024d8b19bc1460692bbabc46943f297 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/7024d8b19bc1460692bbabc46943f297 2023-11-11 04:54:20,830 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/7024d8b19bc1460692bbabc46943f297, entries=1, sequenceid=21, filesize=4.9 K 2023-11-11 04:54:20,831 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c2f996c60d38ae9ae3e9427d010ada7 in 828ms, sequenceid=21, compaction requested=true 2023-11-11 04:54:20,831 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:20,831 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:20,831 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:20,831 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:20,831 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,831 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:20,831 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:20,833 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,833 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:20,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:20,833 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,833 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:20,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:20,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62eab7a7[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:20,835 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:20,835 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,836 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,836 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:20,836 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:20,836 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:20,836 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,836 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:20,838 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:20,838 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,838 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:20,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:20,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:20,838 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:20,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:20,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:20,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:20,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:20,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:20,841 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:20,841 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:20,841 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:20,841 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,841 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:20,843 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:20,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:20,843 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,843 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:20,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:20,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:20,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:20,843 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:20,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,845 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:20,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,850 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,850 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,850 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:20,850 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:20,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:20,850 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:20,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:20,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:20,850 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:20,850 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,850 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:20,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:20,850 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:20,850 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,851 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:20,851 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,951 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:20,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:20,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:20,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:20,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,957 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:20,957 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:20,957 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:20,958 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:20,958 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,958 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,959 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:20,959 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:20,960 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,960 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:20,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,960 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,961 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:20,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,961 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:20,961 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:20,961 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:20,961 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:20,961 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:20,961 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:20,961 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. started... 2023-11-11 04:54:20,961 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c2f996c60d38ae9ae3e9427d010ada7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:20,972 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c4f712d5acc4468eb3d50f1baeca7e2b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c4f712d5acc4468eb3d50f1baeca7e2b 2023-11-11 04:54:20,977 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/196c3d01ef944e32ac2420749146ff76 2023-11-11 04:54:20,982 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/196c3d01ef944e32ac2420749146ff76 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/196c3d01ef944e32ac2420749146ff76 2023-11-11 04:54:20,987 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/196c3d01ef944e32ac2420749146ff76, entries=1, sequenceid=25, filesize=4.9 K 2023-11-11 04:54:20,987 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c2f996c60d38ae9ae3e9427d010ada7 in 26ms, sequenceid=25, compaction requested=true 2023-11-11 04:54:20,987 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:20,988 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:20,989 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,989 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:20,990 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,990 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:20,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:20,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@165f344d[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:20,991 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:20,991 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,993 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,994 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:20,994 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:20,994 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:20,994 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,994 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:20,995 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:20,995 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,995 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:20,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,995 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:20,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:20,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:20,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:20,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:20,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:20,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:20,998 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:20,998 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:20,998 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:20,998 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,998 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:20,999 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:20,999 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:21,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:21,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,000 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:21,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:21,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:21,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:21,000 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,002 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:21,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,004 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,004 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:21,004 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:21,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:21,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:21,004 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:21,004 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,004 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:21,004 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:21,005 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,005 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:21,005 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,005 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:21,005 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:21,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:21,105 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:21,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:21,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:21,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:21,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,111 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:21,111 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:21,111 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:21,111 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:21,111 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,111 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,113 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:21,113 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:21,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:21,114 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,114 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:21,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:21,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,114 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,115 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:21,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,115 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:21,115 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:21,115 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:21,115 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:21,115 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:21,115 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:21,115 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. started... 2023-11-11 04:54:21,115 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c2f996c60d38ae9ae3e9427d010ada7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:21,527 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010154a636a99aa64139b51dcb25983d8b35 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010154a636a99aa64139b51dcb25983d8b35 2023-11-11 04:54:21,933 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/697c7aa14c68432c907f536c885f5ed8 2023-11-11 04:54:21,938 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/697c7aa14c68432c907f536c885f5ed8 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/697c7aa14c68432c907f536c885f5ed8 2023-11-11 04:54:21,942 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/697c7aa14c68432c907f536c885f5ed8, entries=1, sequenceid=29, filesize=4.9 K 2023-11-11 04:54:21,943 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c2f996c60d38ae9ae3e9427d010ada7 in 828ms, sequenceid=29, compaction requested=true 2023-11-11 04:54:21,943 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:21,943 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:21,943 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:21,944 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:21,944 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,944 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:21,944 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:21,945 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,945 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:21,946 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,946 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:21,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:21,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78384ca8[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:21,947 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:21,947 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,949 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,949 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:21,949 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:21,949 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:21,949 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,949 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:21,950 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:21,950 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,950 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:21,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:21,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:21,950 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:21,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:21,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:21,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:21,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:21,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:21,953 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:21,953 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:21,953 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:21,953 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,953 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:21,955 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,955 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:21,956 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:21,956 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:21,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,957 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:21,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,959 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,959 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:21,959 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:21,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:21,960 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:21,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 04:54:21,960 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,960 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:21,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:21,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:21,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:21,960 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:21,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:21,960 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,960 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,960 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:21,960 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:21,960 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:22,061 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:22,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:22,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:22,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:22,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,067 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:22,067 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:22,067 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:22,067 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:22,067 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,067 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,069 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:22,069 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:22,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:22,069 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,069 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:22,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:22,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,070 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,070 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:22,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,070 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:22,070 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:22,070 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:22,070 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:22,071 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:22,071 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:22,071 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. started... 2023-11-11 04:54:22,071 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c2f996c60d38ae9ae3e9427d010ada7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:22,484 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010332b4e903f7d44d23ad6575e0caa72925 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010332b4e903f7d44d23ad6575e0caa72925 2023-11-11 04:54:22,889 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/68eb1dc943b242ba867640eadbffe6ef 2023-11-11 04:54:22,894 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/68eb1dc943b242ba867640eadbffe6ef as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/68eb1dc943b242ba867640eadbffe6ef 2023-11-11 04:54:22,898 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/68eb1dc943b242ba867640eadbffe6ef, entries=1, sequenceid=33, filesize=4.9 K 2023-11-11 04:54:22,899 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c2f996c60d38ae9ae3e9427d010ada7 in 828ms, sequenceid=33, compaction requested=true 2023-11-11 04:54:22,899 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:22,899 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:22,899 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:22,899 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:22,899 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,899 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:22,899 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:22,901 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,901 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:22,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:22,901 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,901 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:22,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:22,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:22,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:22,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:22,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@184b2e6f[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:22,903 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:22,903 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,904 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,904 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:22,904 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:22,904 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:22,904 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,904 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:22,910 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:22,910 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,910 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:22,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:22,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:22,910 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:22,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:22,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:22,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:22,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:22,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:22,913 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:22,913 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:22,913 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:22,913 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,913 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:22,915 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,915 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:22,915 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:22,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:22,915 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:22,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,916 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:22,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,919 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:22,919 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,919 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:22,919 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:22,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:22,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:22,919 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:22,919 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:22,919 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:22,919 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:22,919 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:22,919 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:22,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:22,920 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:22,920 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,020 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:23,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:23,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:23,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:23,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,026 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:23,026 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:23,026 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:23,026 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:23,027 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,027 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,028 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,028 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:23,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:23,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:23,028 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,029 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:23,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:23,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,029 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,030 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:23,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,030 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:23,030 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:23,030 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:23,030 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:23,030 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:23,030 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:23,030 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. started... 2023-11-11 04:54:23,030 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c2f996c60d38ae9ae3e9427d010ada7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:23,443 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076d7c9245d4754e7dad84be3eed175d58 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509076d7c9245d4754e7dad84be3eed175d58 2023-11-11 04:54:23,849 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/a1fa358e6fb246cab3c0f1849e571cc3 2023-11-11 04:54:23,855 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/a1fa358e6fb246cab3c0f1849e571cc3 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/a1fa358e6fb246cab3c0f1849e571cc3 2023-11-11 04:54:23,859 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/a1fa358e6fb246cab3c0f1849e571cc3, entries=1, sequenceid=37, filesize=4.9 K 2023-11-11 04:54:23,860 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c2f996c60d38ae9ae3e9427d010ada7 in 830ms, sequenceid=37, compaction requested=true 2023-11-11 04:54:23,860 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:23,860 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:23,860 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:23,860 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:23,860 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,860 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:23,860 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:23,863 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,863 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:23,863 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,864 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:23,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:23,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f2be54e[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:23,865 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:23,865 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,866 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:23,867 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,867 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:23,868 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:23,868 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,868 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:23,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:23,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:23,868 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:23,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:23,871 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:23,871 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:23,871 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:23,871 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,871 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:23,873 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,873 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:23,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:23,873 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:23,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:23,873 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:23,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:23,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,875 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:23,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,878 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,878 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:23,878 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:23,878 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,878 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:23,878 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:23,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:23,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:23,878 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:23,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 04:54:23,878 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,878 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,878 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,878 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:23,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:23,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:23,879 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:23,979 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:23,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:23,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:23,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:23,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,984 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:23,985 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:23,985 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 04:54:23,985 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 04:54:23,985 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,985 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,986 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:23,986 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:23,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:23,987 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:23,987 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:23,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:23,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,987 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,988 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 04:54:23,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:23,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 04:54:23,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:23,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 04:54:23,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:23,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:23,988 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:23,988 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. started... 2023-11-11 04:54:23,988 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c2f996c60d38ae9ae3e9427d010ada7 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:24,403 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120628b0da0c4ba4f0fa69b4919bee3e6fe to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120628b0da0c4ba4f0fa69b4919bee3e6fe 2023-11-11 04:54:24,809 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/aec6aa1c167e43caa0baba5e58c2e656 2023-11-11 04:54:24,814 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/aec6aa1c167e43caa0baba5e58c2e656 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/aec6aa1c167e43caa0baba5e58c2e656 2023-11-11 04:54:24,818 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/aec6aa1c167e43caa0baba5e58c2e656, entries=1, sequenceid=41, filesize=4.9 K 2023-11-11 04:54:24,818 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c2f996c60d38ae9ae3e9427d010ada7 in 830ms, sequenceid=41, compaction requested=true 2023-11-11 04:54:24,819 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:24,819 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:24,819 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:24,819 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:24,819 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,819 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 04:54:24,819 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 04:54:24,821 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,821 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:24,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:24,821 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,821 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:24,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:24,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:24,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:24,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 04:54:24,822 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 04:54:24,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@403951ba[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:24,823 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,824 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,824 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 04:54:24,824 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 04:54:24,824 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,824 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:24,824 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:24,826 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,826 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 04:54:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:24,826 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:24,826 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 04:54:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:24,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:54:24,829 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 04:54:24,829 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:24,829 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:24,829 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,829 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:24,831 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,831 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:24,831 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:24,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:24,831 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:24,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,833 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:24,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:24,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:24,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:24,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:24,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 04:54:24,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:24,835 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:24,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:24,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:24,835 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:24,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:24,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,836 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:24,836 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,936 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:24,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:24,938 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-11 04:54:24,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:54:24,940 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:54:24,941 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679064941 2023-11-11 04:54:24,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:24,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:54:24,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-11 04:54:24,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:24,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x7c301485 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:54:24,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@359e14e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:54:24,950 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:25,604 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.5384615384615384, tune throughput to 76.92 MB/second 2023-11-11 04:54:25,788 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010320108fa904bd48b6be6ade744cf3ad01 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010320108fa904bd48b6be6ade744cf3ad01 2023-11-11 04:54:25,789 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:25,803 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:54:25,804 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:54:25,810 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:54:25,811 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:54:25,820 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8d1b05cb6b354f4abfa98e8c6b8ca5ab first=Optional[r3] last=Optional[r6] 2023-11-11 04:54:25,820 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8d1b05cb6b354f4abfa98e8c6b8ca5ab}] 2023-11-11 04:54:25,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8d1b05cb6b354f4abfa98e8c6b8ca5ab for inclusion in 1c2f996c60d38ae9ae3e9427d010ada7/family1 2023-11-11 04:54:25,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-11 04:54:25,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:54:25,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:25,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8d1b05cb6b354f4abfa98e8c6b8ca5ab to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyPolicy__oi1joj6dtec6f9lq5tlkdn4amh5gc39naknrf0oapfu3pqtl8p480gu1bgdi98ao/family1/8d1b05cb6b354f4abfa98e8c6b8ca5ab 2023-11-11 04:54:25,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyPolicy__oi1joj6dtec6f9lq5tlkdn4amh5gc39naknrf0oapfu3pqtl8p480gu1bgdi98ao/family1/8d1b05cb6b354f4abfa98e8c6b8ca5ab as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/847581cb22a64133859b8dbf11185d6e_SeqId_44_ 2023-11-11 04:54:25,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyPolicy__oi1joj6dtec6f9lq5tlkdn4amh5gc39naknrf0oapfu3pqtl8p480gu1bgdi98ao/family1/8d1b05cb6b354f4abfa98e8c6b8ca5ab into 1c2f996c60d38ae9ae3e9427d010ada7/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/847581cb22a64133859b8dbf11185d6e_SeqId_44_ - updating store file list. 2023-11-11 04:54:25,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/847581cb22a64133859b8dbf11185d6e_SeqId_44_ into 1c2f996c60d38ae9ae3e9427d010ada7/family1 2023-11-11 04:54:25,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyPolicy__oi1joj6dtec6f9lq5tlkdn4amh5gc39naknrf0oapfu3pqtl8p480gu1bgdi98ao/family1/8d1b05cb6b354f4abfa98e8c6b8ca5ab into 1c2f996c60d38ae9ae3e9427d010ada7/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/847581cb22a64133859b8dbf11185d6e_SeqId_44_) 2023-11-11 04:54:25,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyPolicy__oi1joj6dtec6f9lq5tlkdn4amh5gc39naknrf0oapfu3pqtl8p480gu1bgdi98ao/family1/8d1b05cb6b354f4abfa98e8c6b8ca5ab 2023-11-11 04:54:25,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 04:54:25,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 04:54:25,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): 1c2f996c60d38ae9ae3e9427d010ada7/family1 is initiating minor compaction 2023-11-11 04:54:25,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3bf19fe2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:25,838 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1c2f996c60d38ae9ae3e9427d010ada7/family1 in testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:25,839 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/45ba1bb48b5b462ea445a87a2422f8b6, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/ae5ac79135ab4fe282328971db8f3b93, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/e1a5afadd4cf4086822ea3c55adf7cee, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/7024d8b19bc1460692bbabc46943f297, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/196c3d01ef944e32ac2420749146ff76, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/697c7aa14c68432c907f536c885f5ed8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/68eb1dc943b242ba867640eadbffe6ef, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/a1fa358e6fb246cab3c0f1849e571cc3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/aec6aa1c167e43caa0baba5e58c2e656, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/847581cb22a64133859b8dbf11185d6e_SeqId_44_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp, totalSize=50.0 K 2023-11-11 04:54:25,839 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 45ba1bb48b5b462ea445a87a2422f8b6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 04:54:25,839 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting ae5ac79135ab4fe282328971db8f3b93, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 04:54:25,839 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting e1a5afadd4cf4086822ea3c55adf7cee, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 04:54:25,839 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 7024d8b19bc1460692bbabc46943f297, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 04:54:25,839 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 196c3d01ef944e32ac2420749146ff76, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 04:54:25,839 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 697c7aa14c68432c907f536c885f5ed8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 04:54:25,839 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 68eb1dc943b242ba867640eadbffe6ef, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 04:54:25,839 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting a1fa358e6fb246cab3c0f1849e571cc3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 04:54:25,839 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting aec6aa1c167e43caa0baba5e58c2e656, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 04:54:25,839 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 847581cb22a64133859b8dbf11185d6e_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 04:54:25,840 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:25,841 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:25,843 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228acd52384431442138d41a290c3f408c8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228acd52384431442138d41a290c3f408c8 2023-11-11 04:54:25,844 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c4f712d5acc4468eb3d50f1baeca7e2b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c4f712d5acc4468eb3d50f1baeca7e2b 2023-11-11 04:54:25,846 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010154a636a99aa64139b51dcb25983d8b35 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010154a636a99aa64139b51dcb25983d8b35 2023-11-11 04:54:25,847 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010332b4e903f7d44d23ad6575e0caa72925 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010332b4e903f7d44d23ad6575e0caa72925 2023-11-11 04:54:25,847 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-11 04:54:25,847 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-11 04:54:25,848 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:25,848 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:25,848 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:25,848 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:25,848 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:25,849 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:25,849 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:25,849 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:25,881 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1c2f996c60d38ae9ae3e9427d010ada7#family1#compaction#49 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-11 04:54:26,699 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/bddaf0b0aea1444fae4783ac4da9e01a as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/bddaf0b0aea1444fae4783ac4da9e01a 2023-11-11 04:54:26,704 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1c2f996c60d38ae9ae3e9427d010ada7/family1 of 1c2f996c60d38ae9ae3e9427d010ada7 into bddaf0b0aea1444fae4783ac4da9e01a(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:54:26,704 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:26,704 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699678465838; duration=0sec 2023-11-11 04:54:26,704 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:26,711 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120594f668ffda13428fa0526359f340f43e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120594f668ffda13428fa0526359f340f43e 2023-11-11 04:54:26,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:26,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/45ba1bb48b5b462ea445a87a2422f8b6, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/ae5ac79135ab4fe282328971db8f3b93, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/e1a5afadd4cf4086822ea3c55adf7cee, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/7024d8b19bc1460692bbabc46943f297, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/196c3d01ef944e32ac2420749146ff76, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/697c7aa14c68432c907f536c885f5ed8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/68eb1dc943b242ba867640eadbffe6ef, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/a1fa358e6fb246cab3c0f1849e571cc3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/aec6aa1c167e43caa0baba5e58c2e656, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/847581cb22a64133859b8dbf11185d6e_SeqId_44_] to archive 2023-11-11 04:54:26,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:26,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/45ba1bb48b5b462ea445a87a2422f8b6 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/45ba1bb48b5b462ea445a87a2422f8b6 2023-11-11 04:54:26,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/ae5ac79135ab4fe282328971db8f3b93 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/ae5ac79135ab4fe282328971db8f3b93 2023-11-11 04:54:26,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/e1a5afadd4cf4086822ea3c55adf7cee to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/e1a5afadd4cf4086822ea3c55adf7cee 2023-11-11 04:54:26,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/7024d8b19bc1460692bbabc46943f297 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/7024d8b19bc1460692bbabc46943f297 2023-11-11 04:54:26,753 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:54:26,753 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09b8349a to 127.0.0.1:61842 2023-11-11 04:54:26,753 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:54:26,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/196c3d01ef944e32ac2420749146ff76 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/196c3d01ef944e32ac2420749146ff76 2023-11-11 04:54:26,755 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:54:26,755 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x578400cf to 127.0.0.1:61842 2023-11-11 04:54:26,755 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:54:26,756 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:54:26,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/697c7aa14c68432c907f536c885f5ed8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/697c7aa14c68432c907f536c885f5ed8 2023-11-11 04:54:26,756 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x441dc53d to 127.0.0.1:61842 2023-11-11 04:54:26,756 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:54:26,757 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:54:26,757 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21fe50d5 to 127.0.0.1:61842 2023-11-11 04:54:26,757 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:54:26,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/68eb1dc943b242ba867640eadbffe6ef to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/68eb1dc943b242ba867640eadbffe6ef 2023-11-11 04:54:26,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/a1fa358e6fb246cab3c0f1849e571cc3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/a1fa358e6fb246cab3c0f1849e571cc3 2023-11-11 04:54:26,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/aec6aa1c167e43caa0baba5e58c2e656 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/aec6aa1c167e43caa0baba5e58c2e656 2023-11-11 04:54:26,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/847581cb22a64133859b8dbf11185d6e_SeqId_44_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/847581cb22a64133859b8dbf11185d6e_SeqId_44_ 2023-11-11 04:54:26,771 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4ce87ec35e2c442ca2dd2e4d392fce0c first=Optional[r00] last=Optional[r2] 2023-11-11 04:54:26,771 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4ce87ec35e2c442ca2dd2e4d392fce0c}] 2023-11-11 04:54:26,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4ce87ec35e2c442ca2dd2e4d392fce0c for inclusion in 1c2f996c60d38ae9ae3e9427d010ada7/family1 2023-11-11 04:54:26,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-11 04:54:26,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:54:26,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:26,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4ce87ec35e2c442ca2dd2e4d392fce0c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyPolicy__keq15399ptg16i1q0ngkk184600cbts5ut4sh3qha1cmkdp4mesrohvg5mihqb6q/family1/4ce87ec35e2c442ca2dd2e4d392fce0c 2023-11-11 04:54:26,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyPolicy__keq15399ptg16i1q0ngkk184600cbts5ut4sh3qha1cmkdp4mesrohvg5mihqb6q/family1/4ce87ec35e2c442ca2dd2e4d392fce0c as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/1308fbcc1d844159ac7bc283b00b23c8_SeqId_47_ 2023-11-11 04:54:26,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyPolicy__keq15399ptg16i1q0ngkk184600cbts5ut4sh3qha1cmkdp4mesrohvg5mihqb6q/family1/4ce87ec35e2c442ca2dd2e4d392fce0c into 1c2f996c60d38ae9ae3e9427d010ada7/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/1308fbcc1d844159ac7bc283b00b23c8_SeqId_47_ - updating store file list. 2023-11-11 04:54:26,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/1308fbcc1d844159ac7bc283b00b23c8_SeqId_47_ into 1c2f996c60d38ae9ae3e9427d010ada7/family1 2023-11-11 04:54:26,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyPolicy__keq15399ptg16i1q0ngkk184600cbts5ut4sh3qha1cmkdp4mesrohvg5mihqb6q/family1/4ce87ec35e2c442ca2dd2e4d392fce0c into 1c2f996c60d38ae9ae3e9427d010ada7/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/1308fbcc1d844159ac7bc283b00b23c8_SeqId_47_) 2023-11-11 04:54:26,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyPolicy__keq15399ptg16i1q0ngkk184600cbts5ut4sh3qha1cmkdp4mesrohvg5mihqb6q/family1/4ce87ec35e2c442ca2dd2e4d392fce0c 2023-11-11 04:54:26,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 04:54:26,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 04:54:26,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): 1c2f996c60d38ae9ae3e9427d010ada7/family1 is initiating minor compaction (all files) 2023-11-11 04:54:26,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5eee3c2a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:26,785 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1c2f996c60d38ae9ae3e9427d010ada7/family1 in testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:54:26,785 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/fe05ef95b2bb4f24a86d6427b66c8816, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/bddaf0b0aea1444fae4783ac4da9e01a, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/1308fbcc1d844159ac7bc283b00b23c8_SeqId_47_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp, totalSize=337.0 K 2023-11-11 04:54:26,786 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting fe05ef95b2bb4f24a86d6427b66c8816, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828286 2023-11-11 04:54:26,786 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting bddaf0b0aea1444fae4783ac4da9e01a, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228286 2023-11-11 04:54:26,787 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 1308fbcc1d844159ac7bc283b00b23c8_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878828286 2023-11-11 04:54:26,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:26,788 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:26,790 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113030dba189978c47e4be9171dc5a593761 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113030dba189978c47e4be9171dc5a593761 2023-11-11 04:54:26,791 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201616221d512ca413aaaea98dcec0cbf20 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201616221d512ca413aaaea98dcec0cbf20 2023-11-11 04:54:26,792 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b3736e65a11e48bd938b78ece2cd1f36 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b3736e65a11e48bd938b78ece2cd1f36 2023-11-11 04:54:26,792 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-11 04:54:26,792 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-11 04:54:26,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 04:54:26,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 04:54:26,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:26,794 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:54:26,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8560 sec 2023-11-11 04:54:26,802 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1c2f996c60d38ae9ae3e9427d010ada7#family1#compaction#50 average throughput is 25.77 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-11 04:54:26,888 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=254 (was 262), OpenFileDescriptor=633 (was 654), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=148 (was 175), ProcessCount=169 (was 169), AvailableMemoryMB=2019 (was 2071) 2023-11-11 04:54:26,899 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=254, OpenFileDescriptor=633, MaxFileDescriptor=60000, SystemLoadAverage=148, ProcessCount=169, AvailableMemoryMB=2019 2023-11-11 04:54:26,901 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 04:54:26,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:26,904 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:54:26,904 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-11 04:54:26,904 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:54:26,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-11 04:54:26,905 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:26,906 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa empty. 2023-11-11 04:54:26,906 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:26,907 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-11 04:54:27,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-11 04:54:27,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-11 04:54:27,314 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-11 04:54:27,315 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => a683db6842a4a91eb25a93c544f95aaa, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:54:27,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-11 04:54:27,721 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:27,721 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing a683db6842a4a91eb25a93c544f95aaa, disabling compactions & flushes 2023-11-11 04:54:27,721 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:27,721 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:27,721 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. after waiting 0 ms 2023-11-11 04:54:27,721 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:27,721 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:27,721 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:27,723 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:54:27,724 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699678467724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678467724"}]},"ts":"1699678467724"} 2023-11-11 04:54:27,726 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 04:54:27,726 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:54:27,727 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678467726"}]},"ts":"1699678467726"} 2023-11-11 04:54:27,727 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-11 04:54:27,730 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, ASSIGN}] 2023-11-11 04:54:27,732 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, ASSIGN 2023-11-11 04:54:27,732 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:54:27,883 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a683db6842a4a91eb25a93c544f95aaa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:27,884 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699678467883"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678467883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678467883"}]},"ts":"1699678467883"} 2023-11-11 04:54:27,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure a683db6842a4a91eb25a93c544f95aaa, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:28,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-11 04:54:28,022 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/.tmp/family1/1d3e97e5604a4796b9ba90f1a9ba03e8 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/1d3e97e5604a4796b9ba90f1a9ba03e8 2023-11-11 04:54:28,027 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1c2f996c60d38ae9ae3e9427d010ada7/family1 of 1c2f996c60d38ae9ae3e9427d010ada7 into 1d3e97e5604a4796b9ba90f1a9ba03e8(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:54:28,027 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:54:28,027 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1699678466785; duration=1sec 2023-11-11 04:54:28,027 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:28,036 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:28,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:28,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a683db6842a4a91eb25a93c544f95aaa, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:54:28,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:28,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:28,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:28,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:28,041 INFO [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:28,043 DEBUG [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:28,043 DEBUG [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:28,043 INFO [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a683db6842a4a91eb25a93c544f95aaa columnFamilyName family1 2023-11-11 04:54:28,045 INFO [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] regionserver.HStore(310): Store=a683db6842a4a91eb25a93c544f95aaa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:28,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:28,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:28,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:28,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:54:28,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a683db6842a4a91eb25a93c544f95aaa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75113532, jitterRate=0.11927884817123413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:54:28,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:28,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa., pid=41, masterSystemTime=1699678468036 2023-11-11 04:54:28,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:28,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:28,053 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a683db6842a4a91eb25a93c544f95aaa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:28,053 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699678468053"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678468053"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678468053"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678468053"}]},"ts":"1699678468053"} 2023-11-11 04:54:28,055 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-11 04:54:28,056 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure a683db6842a4a91eb25a93c544f95aaa, server=jenkins-hbase4.apache.org,43941,1699678403879 in 169 msec 2023-11-11 04:54:28,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-11 04:54:28,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, ASSIGN in 326 msec 2023-11-11 04:54:28,058 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:54:28,058 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678468058"}]},"ts":"1699678468058"} 2023-11-11 04:54:28,059 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-11 04:54:28,061 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:54:28,062 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1600 sec 2023-11-11 04:54:28,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/fe05ef95b2bb4f24a86d6427b66c8816, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/bddaf0b0aea1444fae4783ac4da9e01a, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/1308fbcc1d844159ac7bc283b00b23c8_SeqId_47_] to archive 2023-11-11 04:54:28,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:28,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/fe05ef95b2bb4f24a86d6427b66c8816 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/fe05ef95b2bb4f24a86d6427b66c8816 2023-11-11 04:54:28,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/bddaf0b0aea1444fae4783ac4da9e01a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/bddaf0b0aea1444fae4783ac4da9e01a 2023-11-11 04:54:28,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/1308fbcc1d844159ac7bc283b00b23c8_SeqId_47_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/family1/1308fbcc1d844159ac7bc283b00b23c8_SeqId_47_ 2023-11-11 04:54:29,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-11 04:54:29,009 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-11 04:54:29,033 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:29,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,035 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:29,035 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:29,035 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 04:54:29,035 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 04:54:29,036 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,036 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,038 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:29,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:29,038 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:29,038 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,038 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:29,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:29,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,039 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,039 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 04:54:29,039 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:29,040 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 04:54:29,040 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:29,040 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:29,040 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:29,040 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. started... 2023-11-11 04:54:29,041 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a683db6842a4a91eb25a93c544f95aaa 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 04:54:29,060 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f02f904f6ea44066a9a209194174bc6c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130f02f904f6ea44066a9a209194174bc6c 2023-11-11 04:54:29,463 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/1f0142072f6641898caeb291d818ffee 2023-11-11 04:54:29,469 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/1f0142072f6641898caeb291d818ffee as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1f0142072f6641898caeb291d818ffee 2023-11-11 04:54:29,473 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1f0142072f6641898caeb291d818ffee, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-11 04:54:29,474 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a683db6842a4a91eb25a93c544f95aaa in 434ms, sequenceid=5, compaction requested=false 2023-11-11 04:54:29,474 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:29,475 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:29,475 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:29,475 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:29,475 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:29,475 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,475 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 04:54:29,475 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 04:54:29,477 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,477 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:29,477 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,477 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:29,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 04:54:29,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ade0819[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:29,479 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 04:54:29,479 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,480 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,480 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 04:54:29,480 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,480 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:29,480 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 04:54:29,480 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:29,482 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,482 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 04:54:29,482 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:29,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,482 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 04:54:29,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:29,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:29,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:29,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:29,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:29,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 04:54:29,485 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 04:54:29,485 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:29,485 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:29,485 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,485 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:29,491 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,491 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,491 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:29,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:29,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:29,492 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,493 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,496 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:29,496 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:29,496 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:29,496 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:29,496 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:29,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:29,496 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:29,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-11 04:54:29,496 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,496 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,496 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:29,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,497 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:29,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:29,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:29,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,597 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:29,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:29,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:29,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:29,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,604 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:29,604 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:29,604 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 04:54:29,604 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 04:54:29,604 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,604 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,605 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,605 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:29,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:29,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:29,606 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:29,606 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:29,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:29,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,607 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,607 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 04:54:29,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:29,607 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 04:54:29,607 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:29,607 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 04:54:29,607 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:29,607 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:29,607 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:29,607 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. started... 2023-11-11 04:54:29,607 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a683db6842a4a91eb25a93c544f95aaa 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 04:54:30,020 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128160129c4e143468999903b4e10bf4233 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128160129c4e143468999903b4e10bf4233 2023-11-11 04:54:30,025 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/3b6861203cbd4d3f881f61980d1b810e 2023-11-11 04:54:30,030 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/3b6861203cbd4d3f881f61980d1b810e as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/3b6861203cbd4d3f881f61980d1b810e 2023-11-11 04:54:30,034 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/3b6861203cbd4d3f881f61980d1b810e, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 04:54:30,034 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a683db6842a4a91eb25a93c544f95aaa in 427ms, sequenceid=9, compaction requested=false 2023-11-11 04:54:30,035 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:30,035 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:30,035 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:30,035 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:30,035 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,035 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 04:54:30,035 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 04:54:30,037 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,037 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:30,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:30,038 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,038 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:30,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:30,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:30,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:30,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 04:54:30,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b27797b[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:30,039 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 04:54:30,040 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,041 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,041 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 04:54:30,041 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 04:54:30,041 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:30,041 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,041 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:30,042 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,042 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 04:54:30,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,042 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:30,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:30,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:30,043 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 04:54:30,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:30,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:30,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:30,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:30,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 04:54:30,045 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 04:54:30,045 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:30,045 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:30,045 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,045 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:30,047 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,047 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:30,047 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:30,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:30,048 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:30,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,049 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:30,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,054 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,054 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,054 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:30,054 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:30,054 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:30,054 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:30,054 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:30,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:30,054 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,054 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:30,055 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,055 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,055 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:30,055 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-11 04:54:30,055 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:30,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:30,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:30,155 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:30,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:30,159 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:30,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:30,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,161 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:30,161 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:30,161 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 04:54:30,161 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 04:54:30,162 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,162 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,163 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:30,163 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:30,163 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,163 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:30,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,164 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,164 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 04:54:30,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,164 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 04:54:30,164 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:30,164 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 04:54:30,165 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:30,165 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:30,165 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:30,165 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. started... 2023-11-11 04:54:30,165 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a683db6842a4a91eb25a93c544f95aaa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:30,577 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f3001af2ee994a528b41f7ddc702ce58 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201f3001af2ee994a528b41f7ddc702ce58 2023-11-11 04:54:30,983 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/83caece763ab41e69bbde488032d18d1 2023-11-11 04:54:30,987 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/83caece763ab41e69bbde488032d18d1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/83caece763ab41e69bbde488032d18d1 2023-11-11 04:54:30,991 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/83caece763ab41e69bbde488032d18d1, entries=1, sequenceid=13, filesize=5.0 K 2023-11-11 04:54:30,992 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a683db6842a4a91eb25a93c544f95aaa in 827ms, sequenceid=13, compaction requested=true 2023-11-11 04:54:30,992 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:30,992 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:30,992 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:30,992 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:30,992 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,992 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 04:54:30,993 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 04:54:30,994 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,994 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:30,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:30,995 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,995 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:30,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:30,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:30,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:30,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 04:54:30,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bd6eac4[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:30,996 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 04:54:30,996 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,997 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:30,997 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 04:54:30,997 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 04:54:30,997 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:30,998 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:30,998 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:31,000 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 04:54:31,000 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,000 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:31,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:31,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:31,000 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 04:54:31,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:31,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:31,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:31,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:31,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 04:54:31,003 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 04:54:31,003 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:31,003 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:31,003 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,003 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:31,005 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,005 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,005 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:31,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:31,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:31,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:31,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:31,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:31,005 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:31,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,007 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:31,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,009 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,009 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:31,009 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:31,009 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:31,009 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:31,009 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:31,009 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:31,009 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:31,009 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,009 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:31,009 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:31,010 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,010 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:31,010 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:31,110 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:31,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:31,114 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:31,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:31,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,116 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:31,116 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:31,116 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 04:54:31,116 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 04:54:31,116 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,116 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,117 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:31,117 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:31,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:31,118 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,118 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:31,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,119 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,119 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 04:54:31,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,119 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 04:54:31,119 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:31,119 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 04:54:31,119 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:31,119 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:31,119 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:31,119 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. started... 2023-11-11 04:54:31,119 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a683db6842a4a91eb25a93c544f95aaa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:31,531 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c9246fa7b135412bb5ef87d74647657e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c9246fa7b135412bb5ef87d74647657e 2023-11-11 04:54:31,937 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/4a8d1a04dc8442cf92edd7d645eda975 2023-11-11 04:54:31,941 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/4a8d1a04dc8442cf92edd7d645eda975 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/4a8d1a04dc8442cf92edd7d645eda975 2023-11-11 04:54:31,944 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/4a8d1a04dc8442cf92edd7d645eda975, entries=1, sequenceid=17, filesize=5.0 K 2023-11-11 04:54:31,945 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a683db6842a4a91eb25a93c544f95aaa in 826ms, sequenceid=17, compaction requested=true 2023-11-11 04:54:31,945 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:31,945 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:31,945 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:31,945 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:31,945 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,945 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 04:54:31,946 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 04:54:31,948 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:31,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 04:54:31,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41e8c685[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:31,950 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 04:54:31,950 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,951 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,951 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 04:54:31,951 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 04:54:31,951 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:31,951 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,951 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:31,953 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 04:54:31,953 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,953 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:31,953 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 04:54:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:31,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 04:54:31,955 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 04:54:31,955 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:31,955 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:31,955 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,955 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:31,957 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,957 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:31,957 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:31,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:31,958 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,959 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,962 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,962 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,962 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,962 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:31,962 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:31,962 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:31,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-11 04:54:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:31,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:31,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:31,962 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,962 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:31,962 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:31,962 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:31,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:31,963 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:31,963 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:32,063 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:32,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:32,067 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:32,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:32,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,069 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:32,069 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:32,069 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 04:54:32,069 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 04:54:32,070 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,070 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,074 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,074 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:32,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:32,074 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,074 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:32,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,075 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,075 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 04:54:32,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,076 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 04:54:32,076 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:32,076 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 04:54:32,076 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:32,076 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:32,076 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:32,076 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. started... 2023-11-11 04:54:32,076 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a683db6842a4a91eb25a93c544f95aaa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:32,089 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ac6334c60bfa4e6f997b4c9a934385d3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac6334c60bfa4e6f997b4c9a934385d3 2023-11-11 04:54:32,494 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/37c0bf4b9bc044109c7c79c243f6c659 2023-11-11 04:54:32,499 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/37c0bf4b9bc044109c7c79c243f6c659 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/37c0bf4b9bc044109c7c79c243f6c659 2023-11-11 04:54:32,504 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/37c0bf4b9bc044109c7c79c243f6c659, entries=1, sequenceid=21, filesize=5.0 K 2023-11-11 04:54:32,505 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a683db6842a4a91eb25a93c544f95aaa in 429ms, sequenceid=21, compaction requested=true 2023-11-11 04:54:32,505 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:32,505 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:32,505 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:32,505 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:32,505 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,505 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 04:54:32,505 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 04:54:32,507 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,507 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:32,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:32,507 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,507 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:32,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:32,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:32,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:32,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 04:54:32,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b7c9061[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:32,509 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 04:54:32,509 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,511 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 04:54:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 04:54:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:32,512 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,512 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:32,513 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,513 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 04:54:32,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:32,514 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:32,514 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 04:54:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:32,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 04:54:32,516 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 04:54:32,516 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:32,516 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:32,516 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,516 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:32,518 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,519 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:32,518 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:32,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:32,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:32,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:32,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:32,519 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:32,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,521 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:32,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,523 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,523 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,523 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,523 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:32,523 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:32,523 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:32,523 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,523 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:32,523 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:32,524 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:32,523 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,523 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:32,524 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,524 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:32,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:32,624 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:32,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:32,629 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:32,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:32,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,630 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:32,630 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:32,630 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 04:54:32,630 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 04:54:32,631 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,631 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,633 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,633 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:32,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:32,634 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:32,634 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,634 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,635 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 04:54:32,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:32,635 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 04:54:32,635 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:32,635 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 04:54:32,635 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:32,635 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:32,635 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:32,635 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. started... 2023-11-11 04:54:32,635 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a683db6842a4a91eb25a93c544f95aaa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:32,647 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231973572258cf04038a69d42fca84af5f2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231973572258cf04038a69d42fca84af5f2 2023-11-11 04:54:33,053 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/aa5cae97c2c84eb9b73c3b2a87da8dac 2023-11-11 04:54:33,059 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/aa5cae97c2c84eb9b73c3b2a87da8dac as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/aa5cae97c2c84eb9b73c3b2a87da8dac 2023-11-11 04:54:33,063 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/aa5cae97c2c84eb9b73c3b2a87da8dac, entries=1, sequenceid=25, filesize=5.0 K 2023-11-11 04:54:33,063 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a683db6842a4a91eb25a93c544f95aaa in 428ms, sequenceid=25, compaction requested=true 2023-11-11 04:54:33,064 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:33,064 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:33,064 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:33,064 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:33,064 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,064 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 04:54:33,064 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 04:54:33,066 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,066 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:33,066 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,066 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:33,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 04:54:33,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b90d4d4[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:33,068 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 04:54:33,068 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,069 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,069 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 04:54:33,069 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 04:54:33,069 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:33,069 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,069 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:33,070 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,070 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 04:54:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:33,070 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:33,071 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 04:54:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:33,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 04:54:33,073 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 04:54:33,073 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:33,073 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:33,073 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,073 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:33,075 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,075 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:33,075 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:33,076 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,077 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:33,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,079 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,079 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,079 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:33,079 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:33,079 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:33,079 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:33,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:33,079 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:33,079 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:33,079 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,079 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,079 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,080 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,080 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:33,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:33,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:33,080 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:33,180 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:33,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:33,184 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:33,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:33,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,186 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:33,186 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:33,186 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 04:54:33,186 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 04:54:33,186 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,186 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,187 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,187 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:33,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:33,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:33,188 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:33,188 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:33,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,189 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,189 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 04:54:33,189 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:33,189 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 04:54:33,189 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:33,189 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 04:54:33,189 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:33,189 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:33,189 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:33,189 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. started... 2023-11-11 04:54:33,189 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a683db6842a4a91eb25a93c544f95aaa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:33,569 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:54:33,601 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012729bf7714444b0a9c4ad7fad124987a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012729bf7714444b0a9c4ad7fad124987a 2023-11-11 04:54:34,007 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/29813af90dde4d2d9e820884b33acede 2023-11-11 04:54:34,012 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/29813af90dde4d2d9e820884b33acede as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/29813af90dde4d2d9e820884b33acede 2023-11-11 04:54:34,016 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/29813af90dde4d2d9e820884b33acede, entries=1, sequenceid=29, filesize=5.0 K 2023-11-11 04:54:34,017 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a683db6842a4a91eb25a93c544f95aaa in 828ms, sequenceid=29, compaction requested=true 2023-11-11 04:54:34,017 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:34,017 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:34,017 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:34,017 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:34,017 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,017 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 04:54:34,017 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 04:54:34,019 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,019 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:34,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:34,019 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,019 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:34,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:34,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:34,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:34,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 04:54:34,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@376c97a8[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:34,021 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 04:54:34,021 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,023 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,023 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 04:54:34,023 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 04:54:34,023 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:34,023 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,023 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:34,027 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,027 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 04:54:34,027 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:34,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:34,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:34,027 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 04:54:34,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:34,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:34,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:34,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:34,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 04:54:34,030 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 04:54:34,030 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:34,030 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:34,030 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,030 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:34,032 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,032 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:34,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:34,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,032 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:34,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:34,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:34,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:34,033 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:34,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,034 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:34,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,037 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,038 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:34,038 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,038 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:34,038 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:34,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:34,038 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,038 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:34,038 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:34,038 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,038 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,038 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,038 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,038 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:34,038 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:34,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:34,138 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:34,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:34,143 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:34,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:34,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,144 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:34,144 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:34,145 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 04:54:34,145 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 04:54:34,145 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,145 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,146 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,146 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:34,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:34,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:34,147 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,147 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:34,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:34,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,147 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,148 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 04:54:34,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,148 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 04:54:34,148 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:34,148 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 04:54:34,148 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:34,148 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:34,148 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:34,148 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. started... 2023-11-11 04:54:34,148 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a683db6842a4a91eb25a93c544f95aaa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:34,561 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010359d891aa5c27476c9932974694ef2837 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010359d891aa5c27476c9932974694ef2837 2023-11-11 04:54:34,966 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/1fd04a80f1044404af5b372e16876710 2023-11-11 04:54:34,973 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/1fd04a80f1044404af5b372e16876710 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1fd04a80f1044404af5b372e16876710 2023-11-11 04:54:34,976 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1fd04a80f1044404af5b372e16876710, entries=1, sequenceid=33, filesize=5.0 K 2023-11-11 04:54:34,977 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a683db6842a4a91eb25a93c544f95aaa in 829ms, sequenceid=33, compaction requested=true 2023-11-11 04:54:34,977 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:34,977 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 04:54:34,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 04:54:34,979 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,979 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:34,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:34,979 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,979 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:34,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:34,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:34,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:34,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 04:54:34,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30b7a32e[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:34,981 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 04:54:34,981 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,982 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,982 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 04:54:34,982 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 04:54:34,982 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:34,983 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,983 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:34,985 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 04:54:34,985 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,985 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:34,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:34,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:34,985 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 04:54:34,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:34,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:34,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:34,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 04:54:34,987 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 04:54:34,987 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:34,987 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:34,987 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,987 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:34,989 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,989 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:34,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:34,989 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:34,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:34,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:34,990 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,991 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:34,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,993 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,993 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:34,993 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:34,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:34,993 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:34,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:34,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:34,993 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:34,993 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,994 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:34,994 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,994 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,994 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:34,994 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:34,994 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:34,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:34,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:35,094 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:35,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:35,098 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:35,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:35,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,100 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:35,100 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:35,100 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 04:54:35,100 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 04:54:35,101 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,101 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,102 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,102 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:35,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:35,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:35,103 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,103 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:35,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,103 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,104 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 04:54:35,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,104 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 04:54:35,104 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:35,104 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 04:54:35,104 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:35,104 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:35,104 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:35,104 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. started... 2023-11-11 04:54:35,104 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a683db6842a4a91eb25a93c544f95aaa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:35,516 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a924d12164e14fa1acbc8b3d4853fa1a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907a924d12164e14fa1acbc8b3d4853fa1a 2023-11-11 04:54:35,521 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/782521d2b02748a1afd8d0398bb570e6 2023-11-11 04:54:35,525 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/782521d2b02748a1afd8d0398bb570e6 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/782521d2b02748a1afd8d0398bb570e6 2023-11-11 04:54:35,528 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/782521d2b02748a1afd8d0398bb570e6, entries=1, sequenceid=37, filesize=5.0 K 2023-11-11 04:54:35,529 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a683db6842a4a91eb25a93c544f95aaa in 425ms, sequenceid=37, compaction requested=true 2023-11-11 04:54:35,529 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:35,529 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:35,529 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:35,529 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:35,529 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,529 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 04:54:35,529 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 04:54:35,532 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,532 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:35,532 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,532 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:35,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:35,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 04:54:35,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fe7c2c1[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:35,533 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 04:54:35,533 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,535 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,535 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 04:54:35,535 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 04:54:35,535 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:35,535 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,535 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:35,536 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 04:54:35,536 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,536 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:35,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:35,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:35,536 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 04:54:35,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:35,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 04:54:35,538 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 04:54:35,539 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:35,539 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:35,539 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,539 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:35,540 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,540 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:35,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:35,540 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:35,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:35,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:35,541 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:35,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,542 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:35,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,548 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,548 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,548 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:35,548 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,548 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:35,548 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:35,548 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:35,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:35,548 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:35,548 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,548 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:35,548 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,549 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:35,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:35,549 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:35,549 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:35,649 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:35,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:35,653 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:35,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:35,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,655 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:35,655 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:35,655 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 04:54:35,655 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 04:54:35,655 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,655 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,657 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,657 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:35,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:35,657 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:35,657 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:35,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,658 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,658 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 04:54:35,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:35,658 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 04:54:35,658 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:35,658 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 04:54:35,658 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:35,658 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:35,659 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:35,659 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. started... 2023-11-11 04:54:35,659 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a683db6842a4a91eb25a93c544f95aaa 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:36,070 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120640a33e010ae4698a99deb902964ac39 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120640a33e010ae4698a99deb902964ac39 2023-11-11 04:54:36,475 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/c872192dfb384ab8b70cc48791896a36 2023-11-11 04:54:36,480 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/c872192dfb384ab8b70cc48791896a36 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/c872192dfb384ab8b70cc48791896a36 2023-11-11 04:54:36,484 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/c872192dfb384ab8b70cc48791896a36, entries=1, sequenceid=41, filesize=5.0 K 2023-11-11 04:54:36,485 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a683db6842a4a91eb25a93c544f95aaa in 826ms, sequenceid=41, compaction requested=true 2023-11-11 04:54:36,485 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:36,485 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:36,485 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:36,485 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:36,485 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,485 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 04:54:36,485 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 04:54:36,487 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,487 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:36,487 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,487 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:36,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 04:54:36,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@521c939d[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:36,489 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 04:54:36,489 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,490 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,490 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 04:54:36,490 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 04:54:36,490 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:36,490 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,490 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:36,492 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,492 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 04:54:36,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:36,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:36,492 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:36,492 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 04:54:36,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:36,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:36,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:36,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:36,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 04:54:36,495 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 04:54:36,495 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:36,495 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:36,495 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,495 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:36,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:36,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:36,498 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:36,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,499 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:36,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,501 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,501 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,501 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:36,501 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:36,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:36,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:36,501 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,502 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:36,502 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,502 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:36,502 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 04:54:36,502 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:36,502 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,502 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:36,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:36,502 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:36,502 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:36,602 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:36,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:36,604 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:36,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 04:54:36,606 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 04:54:36,607 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679076607 2023-11-11 04:54:36,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:36,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:54:36,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-11 04:54:36,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:36,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x42a33be4 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:54:36,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75f2e60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:54:36,614 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:37,448 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103bee086b7500a4f01bd60fa32bb8ec6db to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103bee086b7500a4f01bd60fa32bb8ec6db 2023-11-11 04:54:37,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:37,462 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:54:37,463 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:54:37,469 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:54:37,471 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:54:37,478 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d289c4388ee2483fab396464a5e8e02d first=Optional[r3] last=Optional[r6] 2023-11-11 04:54:37,479 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d289c4388ee2483fab396464a5e8e02d}] 2023-11-11 04:54:37,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d289c4388ee2483fab396464a5e8e02d for inclusion in a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:37,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-11 04:54:37,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:54:37,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:37,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d289c4388ee2483fab396464a5e8e02d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__s92n38nd48ddfhdnlrdcuhic5v9cqhq2tbt8hht38jjp0ldiq9gp4sdf5s049cdn/family1/d289c4388ee2483fab396464a5e8e02d 2023-11-11 04:54:37,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__s92n38nd48ddfhdnlrdcuhic5v9cqhq2tbt8hht38jjp0ldiq9gp4sdf5s049cdn/family1/d289c4388ee2483fab396464a5e8e02d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/7c762c63053c4a9e99d54d4f6bdd12ac_SeqId_44_ 2023-11-11 04:54:37,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__s92n38nd48ddfhdnlrdcuhic5v9cqhq2tbt8hht38jjp0ldiq9gp4sdf5s049cdn/family1/d289c4388ee2483fab396464a5e8e02d into a683db6842a4a91eb25a93c544f95aaa/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/7c762c63053c4a9e99d54d4f6bdd12ac_SeqId_44_ - updating store file list. 2023-11-11 04:54:37,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/7c762c63053c4a9e99d54d4f6bdd12ac_SeqId_44_ into a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:37,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__s92n38nd48ddfhdnlrdcuhic5v9cqhq2tbt8hht38jjp0ldiq9gp4sdf5s049cdn/family1/d289c4388ee2483fab396464a5e8e02d into a683db6842a4a91eb25a93c544f95aaa/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/7c762c63053c4a9e99d54d4f6bdd12ac_SeqId_44_) 2023-11-11 04:54:37,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__s92n38nd48ddfhdnlrdcuhic5v9cqhq2tbt8hht38jjp0ldiq9gp4sdf5s049cdn/family1/d289c4388ee2483fab396464a5e8e02d 2023-11-11 04:54:37,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 04:54:37,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 04:54:37,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): a683db6842a4a91eb25a93c544f95aaa/family1 is initiating minor compaction 2023-11-11 04:54:37,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@505d6fa3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:37,495 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a683db6842a4a91eb25a93c544f95aaa/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:37,495 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/3b6861203cbd4d3f881f61980d1b810e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/83caece763ab41e69bbde488032d18d1, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/4a8d1a04dc8442cf92edd7d645eda975, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/37c0bf4b9bc044109c7c79c243f6c659, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/aa5cae97c2c84eb9b73c3b2a87da8dac, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/29813af90dde4d2d9e820884b33acede, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1fd04a80f1044404af5b372e16876710, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/782521d2b02748a1afd8d0398bb570e6, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/c872192dfb384ab8b70cc48791896a36, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/7c762c63053c4a9e99d54d4f6bdd12ac_SeqId_44_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp, totalSize=50.4 K 2023-11-11 04:54:37,495 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 3b6861203cbd4d3f881f61980d1b810e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 04:54:37,495 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 83caece763ab41e69bbde488032d18d1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 04:54:37,495 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 4a8d1a04dc8442cf92edd7d645eda975, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 04:54:37,495 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 37c0bf4b9bc044109c7c79c243f6c659, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 04:54:37,495 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting aa5cae97c2c84eb9b73c3b2a87da8dac, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 04:54:37,495 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 29813af90dde4d2d9e820884b33acede, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 04:54:37,495 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 1fd04a80f1044404af5b372e16876710, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 04:54:37,495 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 782521d2b02748a1afd8d0398bb570e6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 04:54:37,495 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting c872192dfb384ab8b70cc48791896a36, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 04:54:37,495 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 7c762c63053c4a9e99d54d4f6bdd12ac_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 04:54:37,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:37,497 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:37,499 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac6334c60bfa4e6f997b4c9a934385d3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac6334c60bfa4e6f997b4c9a934385d3 2023-11-11 04:54:37,500 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231973572258cf04038a69d42fca84af5f2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231973572258cf04038a69d42fca84af5f2 2023-11-11 04:54:37,502 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012729bf7714444b0a9c4ad7fad124987a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012729bf7714444b0a9c4ad7fad124987a 2023-11-11 04:54:37,503 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010359d891aa5c27476c9932974694ef2837 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010359d891aa5c27476c9932974694ef2837 2023-11-11 04:54:37,503 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-11 04:54:37,503 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-11 04:54:37,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:37,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:37,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:37,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:37,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:37,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:37,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:37,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:37,539 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): a683db6842a4a91eb25a93c544f95aaa#family1#compaction#61 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-11 04:54:37,971 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/aecac1414d5c42cd9519bd545b93feb4 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/aecac1414d5c42cd9519bd545b93feb4 2023-11-11 04:54:37,976 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a683db6842a4a91eb25a93c544f95aaa/family1 of a683db6842a4a91eb25a93c544f95aaa into aecac1414d5c42cd9519bd545b93feb4(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:54:37,976 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:37,976 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699678477495; duration=0sec 2023-11-11 04:54:37,976 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:38,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/3b6861203cbd4d3f881f61980d1b810e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/83caece763ab41e69bbde488032d18d1, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/4a8d1a04dc8442cf92edd7d645eda975, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/37c0bf4b9bc044109c7c79c243f6c659, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/aa5cae97c2c84eb9b73c3b2a87da8dac, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/29813af90dde4d2d9e820884b33acede, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1fd04a80f1044404af5b372e16876710, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/782521d2b02748a1afd8d0398bb570e6, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/c872192dfb384ab8b70cc48791896a36, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/7c762c63053c4a9e99d54d4f6bdd12ac_SeqId_44_] to archive 2023-11-11 04:54:38,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:38,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/3b6861203cbd4d3f881f61980d1b810e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/3b6861203cbd4d3f881f61980d1b810e 2023-11-11 04:54:38,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/83caece763ab41e69bbde488032d18d1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/83caece763ab41e69bbde488032d18d1 2023-11-11 04:54:38,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/4a8d1a04dc8442cf92edd7d645eda975 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/4a8d1a04dc8442cf92edd7d645eda975 2023-11-11 04:54:38,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/37c0bf4b9bc044109c7c79c243f6c659 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/37c0bf4b9bc044109c7c79c243f6c659 2023-11-11 04:54:38,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/aa5cae97c2c84eb9b73c3b2a87da8dac to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/aa5cae97c2c84eb9b73c3b2a87da8dac 2023-11-11 04:54:38,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/29813af90dde4d2d9e820884b33acede to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/29813af90dde4d2d9e820884b33acede 2023-11-11 04:54:38,040 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1fd04a80f1044404af5b372e16876710 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1fd04a80f1044404af5b372e16876710 2023-11-11 04:54:38,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/782521d2b02748a1afd8d0398bb570e6 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/782521d2b02748a1afd8d0398bb570e6 2023-11-11 04:54:38,042 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/c872192dfb384ab8b70cc48791896a36 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/c872192dfb384ab8b70cc48791896a36 2023-11-11 04:54:38,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/7c762c63053c4a9e99d54d4f6bdd12ac_SeqId_44_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/7c762c63053c4a9e99d54d4f6bdd12ac_SeqId_44_ 2023-11-11 04:54:38,372 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120556b99a4b4e724620b5c585ed6c4e8d90 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120556b99a4b4e724620b5c585ed6c4e8d90 2023-11-11 04:54:38,373 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:38,395 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da81c8e0435b4889b828f09f3b0acf4e first=Optional[r00] last=Optional[r2] 2023-11-11 04:54:38,396 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da81c8e0435b4889b828f09f3b0acf4e}] 2023-11-11 04:54:38,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da81c8e0435b4889b828f09f3b0acf4e for inclusion in a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:38,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-11 04:54:38,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:54:38,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:38,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da81c8e0435b4889b828f09f3b0acf4e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hkvg6nmvhvcmc0eiu2jvkeu11jct9o3ivb54gjj8k6941n3vfkf3il0shfrtdft9/family1/da81c8e0435b4889b828f09f3b0acf4e 2023-11-11 04:54:38,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hkvg6nmvhvcmc0eiu2jvkeu11jct9o3ivb54gjj8k6941n3vfkf3il0shfrtdft9/family1/da81c8e0435b4889b828f09f3b0acf4e as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6ff1ba0b34c247f49ddc181837f9dd03_SeqId_47_ 2023-11-11 04:54:38,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hkvg6nmvhvcmc0eiu2jvkeu11jct9o3ivb54gjj8k6941n3vfkf3il0shfrtdft9/family1/da81c8e0435b4889b828f09f3b0acf4e into a683db6842a4a91eb25a93c544f95aaa/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6ff1ba0b34c247f49ddc181837f9dd03_SeqId_47_ - updating store file list. 2023-11-11 04:54:38,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6ff1ba0b34c247f49ddc181837f9dd03_SeqId_47_ into a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:38,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hkvg6nmvhvcmc0eiu2jvkeu11jct9o3ivb54gjj8k6941n3vfkf3il0shfrtdft9/family1/da81c8e0435b4889b828f09f3b0acf4e into a683db6842a4a91eb25a93c544f95aaa/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6ff1ba0b34c247f49ddc181837f9dd03_SeqId_47_) 2023-11-11 04:54:38,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hkvg6nmvhvcmc0eiu2jvkeu11jct9o3ivb54gjj8k6941n3vfkf3il0shfrtdft9/family1/da81c8e0435b4889b828f09f3b0acf4e 2023-11-11 04:54:38,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 04:54:38,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 04:54:38,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): a683db6842a4a91eb25a93c544f95aaa/family1 is initiating minor compaction (all files) 2023-11-11 04:54:38,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@27f64d5f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:38,409 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a683db6842a4a91eb25a93c544f95aaa/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:38,410 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1f0142072f6641898caeb291d818ffee, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/aecac1414d5c42cd9519bd545b93feb4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6ff1ba0b34c247f49ddc181837f9dd03_SeqId_47_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp, totalSize=390.1 K 2023-11-11 04:54:38,410 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 1f0142072f6641898caeb291d818ffee, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828286 2023-11-11 04:54:38,410 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting aecac1414d5c42cd9519bd545b93feb4, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228286 2023-11-11 04:54:38,411 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 6ff1ba0b34c247f49ddc181837f9dd03_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878828286 2023-11-11 04:54:38,411 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:38,412 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:38,413 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130f02f904f6ea44066a9a209194174bc6c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130f02f904f6ea44066a9a209194174bc6c 2023-11-11 04:54:38,414 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201f3001af2ee994a528b41f7ddc702ce58 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201f3001af2ee994a528b41f7ddc702ce58 2023-11-11 04:54:38,416 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c9246fa7b135412bb5ef87d74647657e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c9246fa7b135412bb5ef87d74647657e 2023-11-11 04:54:38,416 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-11 04:54:38,416 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-11 04:54:38,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:38,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:38,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:38,417 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 04:54:38,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8120 sec 2023-11-11 04:54:38,425 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): a683db6842a4a91eb25a93c544f95aaa#family1#compaction#62 average throughput is 30.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-11 04:54:38,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-11 04:54:38,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:38,894 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-11 04:54:38,895 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-11 04:54:38,896 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-11 04:54:38,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-11 04:54:38,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, REOPEN/MOVE}] 2023-11-11 04:54:38,900 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, REOPEN/MOVE 2023-11-11 04:54:38,901 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a683db6842a4a91eb25a93c544f95aaa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:38,901 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699678478901"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678478901"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678478901"}]},"ts":"1699678478901"} 2023-11-11 04:54:38,902 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure a683db6842a4a91eb25a93c544f95aaa, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:39,053 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:39,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:39,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a683db6842a4a91eb25a93c544f95aaa, disabling compactions & flushes 2023-11-11 04:54:39,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:39,258 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/.tmp/family1/b756a50d59a845668b770e52d6987364 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/b756a50d59a845668b770e52d6987364 2023-11-11 04:54:39,262 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a683db6842a4a91eb25a93c544f95aaa/family1 of a683db6842a4a91eb25a93c544f95aaa into b756a50d59a845668b770e52d6987364(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:54:39,262 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:39,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:39,262 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1699678478409; duration=0sec 2023-11-11 04:54:39,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:39,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. after waiting 0 ms 2023-11-11 04:54:39,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:39,262 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:39,264 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1f0142072f6641898caeb291d818ffee, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/aecac1414d5c42cd9519bd545b93feb4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6ff1ba0b34c247f49ddc181837f9dd03_SeqId_47_] to archive 2023-11-11 04:54:39,264 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:39,266 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1f0142072f6641898caeb291d818ffee to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/1f0142072f6641898caeb291d818ffee 2023-11-11 04:54:39,267 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/aecac1414d5c42cd9519bd545b93feb4 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/aecac1414d5c42cd9519bd545b93feb4 2023-11-11 04:54:39,268 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6ff1ba0b34c247f49ddc181837f9dd03_SeqId_47_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6ff1ba0b34c247f49ddc181837f9dd03_SeqId_47_ 2023-11-11 04:54:39,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-11 04:54:39,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:39,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:39,274 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: a683db6842a4a91eb25a93c544f95aaa to self. 2023-11-11 04:54:39,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:39,276 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a683db6842a4a91eb25a93c544f95aaa, regionState=CLOSED 2023-11-11 04:54:39,276 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699678479276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678479276"}]},"ts":"1699678479276"} 2023-11-11 04:54:39,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-11 04:54:39,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure a683db6842a4a91eb25a93c544f95aaa, server=jenkins-hbase4.apache.org,43941,1699678403879 in 375 msec 2023-11-11 04:54:39,279 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=true 2023-11-11 04:54:39,429 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a683db6842a4a91eb25a93c544f95aaa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:39,429 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699678479429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678479429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678479429"}]},"ts":"1699678479429"} 2023-11-11 04:54:39,431 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure a683db6842a4a91eb25a93c544f95aaa, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:39,582 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:39,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:39,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a683db6842a4a91eb25a93c544f95aaa, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:54:39,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:39,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:39,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:39,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:39,586 INFO [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:39,587 DEBUG [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:39,587 DEBUG [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:39,588 INFO [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a683db6842a4a91eb25a93c544f95aaa columnFamilyName family1 2023-11-11 04:54:39,592 DEBUG [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/b756a50d59a845668b770e52d6987364 2023-11-11 04:54:39,592 INFO [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] regionserver.HStore(310): Store=a683db6842a4a91eb25a93c544f95aaa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:39,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:39,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:39,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:39,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a683db6842a4a91eb25a93c544f95aaa; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60678711, jitterRate=-0.09581674635410309}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:54:39,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:39,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa., pid=47, masterSystemTime=1699678479582 2023-11-11 04:54:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:39,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:39,599 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a683db6842a4a91eb25a93c544f95aaa, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:39,599 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699678479599"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678479599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678479599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678479599"}]},"ts":"1699678479599"} 2023-11-11 04:54:39,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-11 04:54:39,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure a683db6842a4a91eb25a93c544f95aaa, server=jenkins-hbase4.apache.org,43941,1699678403879 in 170 msec 2023-11-11 04:54:39,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-11 04:54:39,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, REOPEN/MOVE in 702 msec 2023-11-11 04:54:39,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-11 04:54:39,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 706 msec 2023-11-11 04:54:39,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1200 sec 2023-11-11 04:54:39,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-11 04:54:39,608 INFO [Listener at localhost/35271] compactions.TestMobCompactor(278): alter status finished 2023-11-11 04:54:39,609 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:39,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 04:54:39,611 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 04:54:39,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:39,611 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679079611 2023-11-11 04:54:39,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:54:39,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-11 04:54:39,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:39,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x20823871 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:54:39,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e503e2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:54:39,618 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:39,618 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:39,618 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:39,618 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:39,618 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:40,443 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284cead0583dc14ede89d6be1c0fd43d2c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511284cead0583dc14ede89d6be1c0fd43d2c 2023-11-11 04:54:40,444 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:40,456 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:54:40,458 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:54:40,463 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:54:40,465 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:54:40,472 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aa697eab579c425b82a2a1d9eab05cd9 first=Optional[r05] last=Optional[r8] 2023-11-11 04:54:40,473 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=51 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aa697eab579c425b82a2a1d9eab05cd9}] 2023-11-11 04:54:40,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aa697eab579c425b82a2a1d9eab05cd9 for inclusion in a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:40,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-11 04:54:40,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:54:40,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:40,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aa697eab579c425b82a2a1d9eab05cd9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uc5bmjkmdd151gfu71ee79btuke6d5jd6ansh7gkl9r95d5ge6bkr1md8l2reod/family1/aa697eab579c425b82a2a1d9eab05cd9 2023-11-11 04:54:40,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uc5bmjkmdd151gfu71ee79btuke6d5jd6ansh7gkl9r95d5ge6bkr1md8l2reod/family1/aa697eab579c425b82a2a1d9eab05cd9 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6332ada3585a449491c2f30f66dbe264_SeqId_53_ 2023-11-11 04:54:40,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uc5bmjkmdd151gfu71ee79btuke6d5jd6ansh7gkl9r95d5ge6bkr1md8l2reod/family1/aa697eab579c425b82a2a1d9eab05cd9 into a683db6842a4a91eb25a93c544f95aaa/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6332ada3585a449491c2f30f66dbe264_SeqId_53_ - updating store file list. 2023-11-11 04:54:40,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6332ada3585a449491c2f30f66dbe264_SeqId_53_ into a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:40,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uc5bmjkmdd151gfu71ee79btuke6d5jd6ansh7gkl9r95d5ge6bkr1md8l2reod/family1/aa697eab579c425b82a2a1d9eab05cd9 into a683db6842a4a91eb25a93c544f95aaa/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6332ada3585a449491c2f30f66dbe264_SeqId_53_) 2023-11-11 04:54:40,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uc5bmjkmdd151gfu71ee79btuke6d5jd6ansh7gkl9r95d5ge6bkr1md8l2reod/family1/aa697eab579c425b82a2a1d9eab05cd9 2023-11-11 04:54:40,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:40,489 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:40,490 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120640a33e010ae4698a99deb902964ac39 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120640a33e010ae4698a99deb902964ac39 2023-11-11 04:54:40,491 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128160129c4e143468999903b4e10bf4233 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128160129c4e143468999903b4e10bf4233 2023-11-11 04:54:40,491 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-11 04:54:40,492 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-11 04:54:40,492 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:40,492 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:40,492 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:40,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:40,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:40,493 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 04:54:40,494 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 884 msec 2023-11-11 04:54:40,547 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 04:54:40,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:40,957 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-11 04:54:40,958 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-11 04:54:40,958 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-11 04:54:40,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-11 04:54:40,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, REOPEN/MOVE}] 2023-11-11 04:54:40,963 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, REOPEN/MOVE 2023-11-11 04:54:40,963 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a683db6842a4a91eb25a93c544f95aaa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:40,964 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699678480963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678480963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678480963"}]},"ts":"1699678480963"} 2023-11-11 04:54:40,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure a683db6842a4a91eb25a93c544f95aaa, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:41,116 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:41,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:41,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a683db6842a4a91eb25a93c544f95aaa, disabling compactions & flushes 2023-11-11 04:54:41,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:41,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:41,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. after waiting 0 ms 2023-11-11 04:54:41,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:41,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-11 04:54:41,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:41,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:41,123 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: a683db6842a4a91eb25a93c544f95aaa to self. 2023-11-11 04:54:41,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:41,125 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a683db6842a4a91eb25a93c544f95aaa, regionState=CLOSED 2023-11-11 04:54:41,125 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699678481125"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678481125"}]},"ts":"1699678481125"} 2023-11-11 04:54:41,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-11 04:54:41,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure a683db6842a4a91eb25a93c544f95aaa, server=jenkins-hbase4.apache.org,43941,1699678403879 in 161 msec 2023-11-11 04:54:41,128 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=true 2023-11-11 04:54:41,278 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a683db6842a4a91eb25a93c544f95aaa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:41,279 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699678481278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678481278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678481278"}]},"ts":"1699678481278"} 2023-11-11 04:54:41,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure a683db6842a4a91eb25a93c544f95aaa, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:41,431 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:41,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:41,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a683db6842a4a91eb25a93c544f95aaa, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:54:41,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:41,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:41,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:41,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:41,435 INFO [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:41,436 DEBUG [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:41,436 DEBUG [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1 2023-11-11 04:54:41,437 INFO [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a683db6842a4a91eb25a93c544f95aaa columnFamilyName family1 2023-11-11 04:54:41,441 DEBUG [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/6332ada3585a449491c2f30f66dbe264_SeqId_53_ 2023-11-11 04:54:41,445 DEBUG [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/family1/b756a50d59a845668b770e52d6987364 2023-11-11 04:54:41,445 INFO [StoreOpener-a683db6842a4a91eb25a93c544f95aaa-1] regionserver.HStore(310): Store=a683db6842a4a91eb25a93c544f95aaa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:41,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:41,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:41,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:54:41,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a683db6842a4a91eb25a93c544f95aaa; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63329676, jitterRate=-0.056314289569854736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:54:41,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:54:41,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa., pid=53, masterSystemTime=1699678481431 2023-11-11 04:54:41,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:41,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:54:41,452 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a683db6842a4a91eb25a93c544f95aaa, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:41,452 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699678481452"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678481452"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678481452"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678481452"}]},"ts":"1699678481452"} 2023-11-11 04:54:41,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-11 04:54:41,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure a683db6842a4a91eb25a93c544f95aaa, server=jenkins-hbase4.apache.org,43941,1699678403879 in 173 msec 2023-11-11 04:54:41,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-11 04:54:41,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a683db6842a4a91eb25a93c544f95aaa, REOPEN/MOVE in 493 msec 2023-11-11 04:54:41,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-11 04:54:41,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 496 msec 2023-11-11 04:54:41,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 911 msec 2023-11-11 04:54:41,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-11 04:54:41,461 INFO [Listener at localhost/35271] compactions.TestMobCompactor(278): alter status finished 2023-11-11 04:54:41,461 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 04:54:41,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 04:54:41,463 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 04:54:41,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:41,464 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679081464 2023-11-11 04:54:41,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:54:41,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-11 04:54:41,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:41,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x6361e36f to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:54:41,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c9f186a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:54:41,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:41,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:41,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:41,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:41,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:41,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:41,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:41,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 04:54:41,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 04:54:41,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:41,473 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 04:54:41,474 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-11-11 04:54:41,517 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=248 (was 254), OpenFileDescriptor=650 (was 633) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=114 (was 148), ProcessCount=169 (was 169), AvailableMemoryMB=2008 (was 2019) 2023-11-11 04:54:41,528 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=248, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=114, ProcessCount=169, AvailableMemoryMB=2008 2023-11-11 04:54:41,529 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 04:54:41,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:41,531 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:54:41,531 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-11 04:54:41,532 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:54:41,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 04:54:41,533 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:41,533 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf empty. 2023-11-11 04:54:41,533 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:41,533 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-11 04:54:41,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 04:54:41,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 04:54:41,941 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-11 04:54:41,942 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => e382088a27118f8b8a8b885e5576caaf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:54:42,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 04:54:42,348 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:42,348 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing e382088a27118f8b8a8b885e5576caaf, disabling compactions & flushes 2023-11-11 04:54:42,348 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:42,348 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:42,348 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. after waiting 0 ms 2023-11-11 04:54:42,348 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:42,348 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:42,348 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:42,350 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:54:42,351 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699678482351"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678482351"}]},"ts":"1699678482351"} 2023-11-11 04:54:42,352 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 04:54:42,353 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:54:42,353 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678482353"}]},"ts":"1699678482353"} 2023-11-11 04:54:42,354 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-11 04:54:42,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, ASSIGN}] 2023-11-11 04:54:42,359 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, ASSIGN 2023-11-11 04:54:42,359 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:54:42,510 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=e382088a27118f8b8a8b885e5576caaf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:42,510 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699678482510"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678482510"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678482510"}]},"ts":"1699678482510"} 2023-11-11 04:54:42,512 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure e382088a27118f8b8a8b885e5576caaf, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:42,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 04:54:42,663 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:42,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:42,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e382088a27118f8b8a8b885e5576caaf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:54:42,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:42,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:42,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:42,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:42,667 INFO [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:42,669 DEBUG [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:42,669 DEBUG [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:42,669 INFO [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e382088a27118f8b8a8b885e5576caaf columnFamilyName family1 2023-11-11 04:54:42,670 INFO [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] regionserver.HStore(310): Store=e382088a27118f8b8a8b885e5576caaf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:42,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:42,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:42,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:42,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:54:42,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e382088a27118f8b8a8b885e5576caaf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62417906, jitterRate=-0.06990072131156921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:54:42,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:42,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf., pid=57, masterSystemTime=1699678482663 2023-11-11 04:54:42,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:42,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:42,679 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=e382088a27118f8b8a8b885e5576caaf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:42,679 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699678482679"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678482679"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678482679"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678482679"}]},"ts":"1699678482679"} 2023-11-11 04:54:42,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-11 04:54:42,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure e382088a27118f8b8a8b885e5576caaf, server=jenkins-hbase4.apache.org,43941,1699678403879 in 168 msec 2023-11-11 04:54:42,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-11 04:54:42,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, ASSIGN in 324 msec 2023-11-11 04:54:42,683 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:54:42,684 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678482683"}]},"ts":"1699678482683"} 2023-11-11 04:54:42,684 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-11 04:54:42,686 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:54:42,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1570 sec 2023-11-11 04:54:43,585 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:43,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 04:54:43,636 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-11 04:54:43,656 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:43,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:43,658 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:43,658 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:43,658 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 04:54:43,658 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 04:54:43,658 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:43,659 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:43,660 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:43,660 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:43,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:43,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:43,660 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:43,660 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:43,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:43,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:43,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:43,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:43,661 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:43,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:43,662 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 04:54:43,662 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:43,662 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 04:54:43,662 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:43,662 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:43,663 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:43,663 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. started... 2023-11-11 04:54:43,663 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e382088a27118f8b8a8b885e5576caaf 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 04:54:44,080 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113031fdf64ae089485bb26d35f3ee434ccd to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113031fdf64ae089485bb26d35f3ee434ccd 2023-11-11 04:54:44,484 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/be362cf0edde4b21980a532d5ea3f988 2023-11-11 04:54:44,490 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/be362cf0edde4b21980a532d5ea3f988 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/be362cf0edde4b21980a532d5ea3f988 2023-11-11 04:54:44,494 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/be362cf0edde4b21980a532d5ea3f988, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-11 04:54:44,495 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e382088a27118f8b8a8b885e5576caaf in 832ms, sequenceid=5, compaction requested=false 2023-11-11 04:54:44,495 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:44,495 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:44,495 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:44,495 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:44,496 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,496 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 04:54:44,496 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 04:54:44,497 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,497 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:44,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:44,497 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,497 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:44,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 04:54:44,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19e9fa1[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:44,499 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 04:54:44,499 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,500 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 04:54:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 04:54:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:44,501 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,501 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:44,503 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 04:54:44,503 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:44,503 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,503 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 04:54:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:44,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 04:54:44,505 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 04:54:44,505 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:44,505 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:44,505 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,505 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:44,509 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,509 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:44,509 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:44,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:44,509 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,510 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,513 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,513 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:44,513 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,513 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:44,513 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,513 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:44,513 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:44,513 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:44,513 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,513 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:44,513 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:44,513 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,513 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:44,513 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:44,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:44,613 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:44,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:44,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:44,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:44,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,619 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:44,619 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:44,619 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 04:54:44,619 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 04:54:44,619 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,619 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,621 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:44,621 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:44,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:44,622 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:44,622 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:44,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:44,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,622 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 04:54:44,623 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:44,623 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 04:54:44,623 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:44,623 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 04:54:44,623 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:44,623 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:44,623 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:44,623 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. started... 2023-11-11 04:54:44,623 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e382088a27118f8b8a8b885e5576caaf 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 04:54:44,803 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:54:45,035 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e3c99d6a38de4cd4bdd9f170700a0b71 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e3c99d6a38de4cd4bdd9f170700a0b71 2023-11-11 04:54:45,041 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/803c1aa4b3684dcb9075ac2bf3565f43 2023-11-11 04:54:45,046 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/803c1aa4b3684dcb9075ac2bf3565f43 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/803c1aa4b3684dcb9075ac2bf3565f43 2023-11-11 04:54:45,050 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/803c1aa4b3684dcb9075ac2bf3565f43, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 04:54:45,051 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e382088a27118f8b8a8b885e5576caaf in 428ms, sequenceid=9, compaction requested=false 2023-11-11 04:54:45,051 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:45,051 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:45,051 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:45,051 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:45,051 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,051 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 04:54:45,051 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 04:54:45,052 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,052 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:45,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:45,053 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,053 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:45,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:45,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:45,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:45,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 04:54:45,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cbde26f[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:45,055 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 04:54:45,055 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,056 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,056 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 04:54:45,056 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 04:54:45,056 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:45,057 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,057 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:45,058 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 04:54:45,058 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:45,058 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,058 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 04:54:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:45,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 04:54:45,060 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 04:54:45,060 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:45,060 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:45,061 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,061 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:45,064 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,064 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:45,064 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:45,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:45,065 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,066 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,068 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,068 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:45,068 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:45,068 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:45,069 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:45,068 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:45,068 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:45,068 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,069 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,069 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:45,069 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:45,069 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:45,069 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,069 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,169 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:45,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:45,173 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:45,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:45,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,175 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:45,175 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:45,175 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 04:54:45,175 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 04:54:45,175 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,175 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,177 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,177 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:45,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:45,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:45,177 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:45,177 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:45,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,178 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,178 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 04:54:45,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:45,178 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 04:54:45,178 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:45,178 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 04:54:45,178 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:45,179 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:45,179 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. started... 2023-11-11 04:54:45,179 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e382088a27118f8b8a8b885e5576caaf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:45,590 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b1fd924124464b7fb98f7fb3c1fcb359 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b1fd924124464b7fb98f7fb3c1fcb359 2023-11-11 04:54:45,995 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/42e5869212f44985a8b0920d29fa8998 2023-11-11 04:54:46,001 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/42e5869212f44985a8b0920d29fa8998 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/42e5869212f44985a8b0920d29fa8998 2023-11-11 04:54:46,004 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/42e5869212f44985a8b0920d29fa8998, entries=1, sequenceid=13, filesize=5.0 K 2023-11-11 04:54:46,005 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e382088a27118f8b8a8b885e5576caaf in 826ms, sequenceid=13, compaction requested=true 2023-11-11 04:54:46,005 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:46,005 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:46,005 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:46,005 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:46,005 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 04:54:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 04:54:46,007 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:46,008 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,008 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:46,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 04:54:46,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2dedc8f3[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:46,009 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 04:54:46,009 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,011 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,011 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 04:54:46,011 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 04:54:46,011 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:46,011 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,011 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:46,013 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 04:54:46,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,013 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:46,013 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 04:54:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:46,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:46,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:46,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 04:54:46,015 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 04:54:46,016 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:46,016 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:46,016 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,016 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:46,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:46,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:46,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:46,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:46,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:46,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:46,018 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:46,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,020 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:46,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,028 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,028 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:46,028 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:46,028 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:46,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-11 04:54:46,028 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:46,028 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:46,028 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,028 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:46,028 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,028 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,028 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,028 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:46,028 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:46,028 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:46,128 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:46,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:46,133 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:46,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:46,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,134 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:46,134 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:46,134 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 04:54:46,134 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 04:54:46,135 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,135 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,139 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,139 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:46,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:46,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:46,139 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,139 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:46,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:46,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,140 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,140 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 04:54:46,140 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,140 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 04:54:46,140 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:46,141 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 04:54:46,141 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:46,141 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:46,141 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:46,141 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. started... 2023-11-11 04:54:46,141 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e382088a27118f8b8a8b885e5576caaf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:46,552 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120594f957caa2d74e5099106d7e2d8eab24 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120594f957caa2d74e5099106d7e2d8eab24 2023-11-11 04:54:46,957 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/f4e06ee3189d4736b2f3ba7e3181329c 2023-11-11 04:54:46,961 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/f4e06ee3189d4736b2f3ba7e3181329c as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/f4e06ee3189d4736b2f3ba7e3181329c 2023-11-11 04:54:46,965 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/f4e06ee3189d4736b2f3ba7e3181329c, entries=1, sequenceid=17, filesize=5.0 K 2023-11-11 04:54:46,966 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e382088a27118f8b8a8b885e5576caaf in 825ms, sequenceid=17, compaction requested=true 2023-11-11 04:54:46,966 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:46,966 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:46,966 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:46,966 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:46,966 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,966 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 04:54:46,966 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 04:54:46,979 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:46,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:46,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:46,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:46,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:46,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 04:54:46,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bdb36a8[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:46,981 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 04:54:46,981 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,993 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:46,993 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 04:54:46,993 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 04:54:46,993 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:46,993 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:46,994 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:47,008 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 04:54:47,008 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,008 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:47,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:47,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:47,008 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 04:54:47,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:47,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:47,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:47,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:47,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 04:54:47,010 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 04:54:47,010 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:47,010 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:47,010 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,010 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:47,022 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,022 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:47,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,022 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:47,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:47,022 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,024 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,030 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,030 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,030 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:47,030 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,031 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:47,031 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:47,031 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:47,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:47,031 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:47,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:47,031 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,031 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,031 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,031 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:47,031 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:47,031 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:47,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:47,131 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:47,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:47,135 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:47,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:47,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,137 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:47,137 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:47,137 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 04:54:47,137 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 04:54:47,137 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,137 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,140 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:47,140 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:47,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:47,140 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,140 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:47,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,141 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,141 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 04:54:47,141 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 04:54:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 04:54:47,142 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:47,142 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:47,142 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:47,142 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. started... 2023-11-11 04:54:47,142 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e382088a27118f8b8a8b885e5576caaf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:47,554 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285bfd9420c3f240f88d8985732353476a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285bfd9420c3f240f88d8985732353476a 2023-11-11 04:54:47,959 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/b9cb7fb23caf455690a3832eb0ce445c 2023-11-11 04:54:47,964 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/b9cb7fb23caf455690a3832eb0ce445c as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/b9cb7fb23caf455690a3832eb0ce445c 2023-11-11 04:54:47,968 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/b9cb7fb23caf455690a3832eb0ce445c, entries=1, sequenceid=21, filesize=5.0 K 2023-11-11 04:54:47,969 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e382088a27118f8b8a8b885e5576caaf in 827ms, sequenceid=21, compaction requested=true 2023-11-11 04:54:47,969 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:47,969 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:47,969 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:47,969 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:47,969 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,969 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 04:54:47,969 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 04:54:47,972 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,972 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:47,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:47,973 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:47,973 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:47,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:47,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:47,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 04:54:47,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e4dd1e5[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:47,974 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 04:54:47,974 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,975 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,976 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 04:54:47,976 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 04:54:47,976 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:47,976 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,976 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:47,977 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 04:54:47,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:47,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:47,977 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 04:54:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:47,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 04:54:47,980 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 04:54:47,980 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:47,980 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:47,980 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,980 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:47,981 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,981 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:47,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,981 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:47,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:47,982 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,984 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:47,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,987 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,987 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:47,987 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,987 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:47,987 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:47,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:47,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:47,987 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:47,987 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:47,987 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,988 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:47,988 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:47,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:47,988 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:47,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:47,988 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,988 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:47,988 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,088 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:48,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:48,092 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:48,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:48,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,094 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:48,094 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:48,094 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 04:54:48,094 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 04:54:48,095 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,095 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,097 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,097 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:48,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:48,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:48,098 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,098 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:48,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,099 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,099 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 04:54:48,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 04:54:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 04:54:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:48,099 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:48,099 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:48,099 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. started... 2023-11-11 04:54:48,099 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e382088a27118f8b8a8b885e5576caaf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:48,515 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b5bc33da791f4dda9378a627cb13281d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5bc33da791f4dda9378a627cb13281d 2023-11-11 04:54:48,920 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/68076f69f1794c32bb35f42f5c3a93f8 2023-11-11 04:54:48,924 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/68076f69f1794c32bb35f42f5c3a93f8 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/68076f69f1794c32bb35f42f5c3a93f8 2023-11-11 04:54:48,928 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/68076f69f1794c32bb35f42f5c3a93f8, entries=1, sequenceid=25, filesize=5.0 K 2023-11-11 04:54:48,929 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e382088a27118f8b8a8b885e5576caaf in 830ms, sequenceid=25, compaction requested=true 2023-11-11 04:54:48,929 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:48,929 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:48,929 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:48,929 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:48,929 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,929 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 04:54:48,929 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 04:54:48,931 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,931 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:48,931 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,931 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:48,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 04:54:48,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d80e8d9[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:48,933 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 04:54:48,933 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,934 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,934 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 04:54:48,934 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 04:54:48,934 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:48,934 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,934 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:48,936 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 04:54:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,937 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:48,937 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 04:54:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:48,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 04:54:48,939 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 04:54:48,939 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:48,939 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:48,939 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,939 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:48,940 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,940 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:48,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,941 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:48,941 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,942 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:48,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,944 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,944 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:48,944 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:48,945 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:48,945 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:48,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:48,945 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:48,944 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,944 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:48,945 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:48,945 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,945 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:48,945 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:48,945 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:48,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:48,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:48,945 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,045 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:49,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:49,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:49,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:49,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,050 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:49,050 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:49,051 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 04:54:49,051 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 04:54:49,051 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,051 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,059 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,059 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:49,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:49,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:49,059 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,059 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:49,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:49,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,060 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,060 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 04:54:49,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,060 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 04:54:49,060 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:49,060 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 04:54:49,061 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:49,061 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:49,061 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:49,061 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. started... 2023-11-11 04:54:49,061 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e382088a27118f8b8a8b885e5576caaf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:49,472 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010824566fa7ee415187b3965a425adf05 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010824566fa7ee415187b3965a425adf05 2023-11-11 04:54:49,877 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/744e3608e6204836a287183831af2c33 2023-11-11 04:54:49,882 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/744e3608e6204836a287183831af2c33 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/744e3608e6204836a287183831af2c33 2023-11-11 04:54:49,885 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/744e3608e6204836a287183831af2c33, entries=1, sequenceid=29, filesize=5.0 K 2023-11-11 04:54:49,886 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e382088a27118f8b8a8b885e5576caaf in 825ms, sequenceid=29, compaction requested=true 2023-11-11 04:54:49,886 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:49,886 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 04:54:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 04:54:49,889 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,889 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:49,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:49,890 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,890 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:49,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:49,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:49,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:49,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 04:54:49,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e6913ca[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:49,891 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 04:54:49,891 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,892 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,892 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 04:54:49,892 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 04:54:49,892 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:49,893 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,893 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:49,894 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 04:54:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 04:54:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:49,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 04:54:49,896 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 04:54:49,896 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:49,896 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:49,896 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,896 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:49,898 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,898 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:49,898 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:49,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:49,898 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,900 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:49,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,903 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,903 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,903 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:49,903 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,903 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:49,903 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:49,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:49,903 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:49,903 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:49,903 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,903 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:49,903 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,903 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:49,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:49,903 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:49,903 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:50,004 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:50,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:50,008 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:50,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:50,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,009 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:50,009 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:50,009 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 04:54:50,009 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 04:54:50,010 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,010 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,011 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,011 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:50,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:50,011 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,011 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,012 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,012 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 04:54:50,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,012 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 04:54:50,012 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:50,013 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 04:54:50,013 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:50,013 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:50,013 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:50,013 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. started... 2023-11-11 04:54:50,013 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e382088a27118f8b8a8b885e5576caaf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:50,424 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010322723add3f5b4fb6892974b0e2697345 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010322723add3f5b4fb6892974b0e2697345 2023-11-11 04:54:50,429 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/9827deba856f4245b15773df9e358c89 2023-11-11 04:54:50,435 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/9827deba856f4245b15773df9e358c89 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/9827deba856f4245b15773df9e358c89 2023-11-11 04:54:50,439 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/9827deba856f4245b15773df9e358c89, entries=1, sequenceid=33, filesize=5.0 K 2023-11-11 04:54:50,439 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e382088a27118f8b8a8b885e5576caaf in 426ms, sequenceid=33, compaction requested=true 2023-11-11 04:54:50,439 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:50,439 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:50,439 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:50,439 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:50,440 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,440 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 04:54:50,440 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 04:54:50,441 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,441 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:50,441 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,441 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:50,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:50,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:50,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 04:54:50,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c4502d9[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:50,443 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 04:54:50,443 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,444 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,444 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 04:54:50,444 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 04:54:50,444 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:50,444 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,444 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:50,449 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 04:54:50,449 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:50,449 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,449 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 04:54:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:50,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:50,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:50,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 04:54:50,451 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 04:54:50,451 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:50,451 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:50,451 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,451 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:50,453 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,453 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,453 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:50,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:50,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:50,454 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,455 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,457 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,457 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,457 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:50,457 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,457 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:50,457 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:50,457 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,457 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,457 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,457 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:50,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:50,457 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:50,457 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:50,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-11 04:54:50,457 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:50,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:50,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:50,458 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:50,558 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:50,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:50,562 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:50,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:50,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,564 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:50,564 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:50,564 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 04:54:50,564 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 04:54:50,564 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,564 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,566 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:50,566 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:50,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:50,566 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:50,566 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:50,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:50,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,567 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,567 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 04:54:50,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:50,567 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 04:54:50,567 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:50,568 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 04:54:50,577 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:50,577 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:50,577 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:50,577 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. started... 2023-11-11 04:54:50,577 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e382088a27118f8b8a8b885e5576caaf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:50,992 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509075e52135a29ba475089eeb203e844ab0e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509075e52135a29ba475089eeb203e844ab0e 2023-11-11 04:54:51,000 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/cfc395d052664a11958e8d04c7c73c63 2023-11-11 04:54:51,005 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/cfc395d052664a11958e8d04c7c73c63 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/cfc395d052664a11958e8d04c7c73c63 2023-11-11 04:54:51,009 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/cfc395d052664a11958e8d04c7c73c63, entries=1, sequenceid=37, filesize=5.0 K 2023-11-11 04:54:51,009 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e382088a27118f8b8a8b885e5576caaf in 432ms, sequenceid=37, compaction requested=true 2023-11-11 04:54:51,010 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:51,010 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:51,010 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:51,010 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:51,010 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,010 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 04:54:51,010 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 04:54:51,015 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,015 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:51,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:51,016 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,016 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:51,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:51,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:51,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:51,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 04:54:51,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c87384d[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:51,017 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 04:54:51,018 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,019 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,019 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 04:54:51,019 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 04:54:51,019 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:51,019 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,019 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:51,020 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 04:54:51,020 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,020 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:51,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:51,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:51,021 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 04:54:51,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:51,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:51,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:51,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:51,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 04:54:51,023 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 04:54:51,023 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:51,023 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:51,023 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,023 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:51,024 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,025 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,025 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:51,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:51,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:51,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:51,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:51,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:51,025 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:51,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,027 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:51,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,030 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,030 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:51,030 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:51,030 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:51,030 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:51,030 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:51,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-11 04:54:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:51,030 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:51,030 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,031 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:51,031 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:51,031 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:51,031 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:51,031 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,031 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,131 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:51,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:51,135 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:54:51,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 04:54:51,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,137 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:51,137 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:51,137 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 04:54:51,137 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 04:54:51,137 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,137 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,138 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:51,138 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:51,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:51,139 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,139 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:54:51,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:54:51,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,139 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,140 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 04:54:51,140 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,140 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 04:54:51,140 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:54:51,140 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 04:54:51,140 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:54:51,140 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:54:51,140 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:51,140 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. started... 2023-11-11 04:54:51,140 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e382088a27118f8b8a8b885e5576caaf 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:54:51,551 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205dc428d23923450ba33b50dff80f4129 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511205dc428d23923450ba33b50dff80f4129 2023-11-11 04:54:51,956 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/96c0e537c83f48ff9dc97638736ae10c 2023-11-11 04:54:51,960 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/96c0e537c83f48ff9dc97638736ae10c as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/96c0e537c83f48ff9dc97638736ae10c 2023-11-11 04:54:51,964 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/96c0e537c83f48ff9dc97638736ae10c, entries=1, sequenceid=41, filesize=5.0 K 2023-11-11 04:54:51,965 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e382088a27118f8b8a8b885e5576caaf in 825ms, sequenceid=41, compaction requested=true 2023-11-11 04:54:51,965 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:51,965 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:51,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:54:51,965 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:54:51,966 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,966 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 04:54:51,966 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 04:54:51,967 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,967 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:51,967 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,967 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:54:51,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:51,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:51,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:51,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 04:54:51,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64bdf24[Count = 0] remaining members to acquire global barrier 2023-11-11 04:54:51,969 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 04:54:51,969 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,970 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,970 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 04:54:51,970 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,970 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:54:51,970 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 04:54:51,970 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:54:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 04:54:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:51,973 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 04:54:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:51,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:51,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:51,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:54:51,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 04:54:51,975 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 04:54:51,975 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:54:51,975 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:54:51,975 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,976 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:54:51,977 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,977 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:54:51,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:54:51,977 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:51,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:54:51,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:51,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:51,978 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:54:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,979 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:54:51,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,984 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,984 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,984 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:54:51,984 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:54:51,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:54:51,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-11 04:54:51,984 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:54:51,984 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 04:54:51,984 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:54:51,984 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:54:51,984 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:51,984 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,984 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,984 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:51,984 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 04:54:51,984 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:54:51,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:54:51,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:54:52,084 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:54:52,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:54:52,086 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:52,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 04:54:52,088 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 04:54:52,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:52,089 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679092089 2023-11-11 04:54:52,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:54:52,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-11 04:54:52,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:52,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x5c3e97ee to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:54:52,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10691b0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:54:52,097 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:52,928 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d543e3953f564c778f1251dfe830035a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103d543e3953f564c778f1251dfe830035a 2023-11-11 04:54:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:52,941 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:54:52,942 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:54:52,949 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:54:52,950 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:54:52,958 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33d09cd3ce6141e1bef1e4117dcae083 first=Optional[r3] last=Optional[r6] 2023-11-11 04:54:52,959 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33d09cd3ce6141e1bef1e4117dcae083}] 2023-11-11 04:54:52,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33d09cd3ce6141e1bef1e4117dcae083 for inclusion in e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:52,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-11 04:54:52,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:54:52,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:52,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33d09cd3ce6141e1bef1e4117dcae083 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o40umkrnfvaa48eerbl5ii05ajg6p76tb362rp2g1qpp09hs9fqv0qhq6rbmacs3/family1/33d09cd3ce6141e1bef1e4117dcae083 2023-11-11 04:54:52,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o40umkrnfvaa48eerbl5ii05ajg6p76tb362rp2g1qpp09hs9fqv0qhq6rbmacs3/family1/33d09cd3ce6141e1bef1e4117dcae083 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/205ef15b36e44d64b5c5752cce4786d0_SeqId_44_ 2023-11-11 04:54:52,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o40umkrnfvaa48eerbl5ii05ajg6p76tb362rp2g1qpp09hs9fqv0qhq6rbmacs3/family1/33d09cd3ce6141e1bef1e4117dcae083 into e382088a27118f8b8a8b885e5576caaf/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/205ef15b36e44d64b5c5752cce4786d0_SeqId_44_ - updating store file list. 2023-11-11 04:54:52,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/205ef15b36e44d64b5c5752cce4786d0_SeqId_44_ into e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:52,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o40umkrnfvaa48eerbl5ii05ajg6p76tb362rp2g1qpp09hs9fqv0qhq6rbmacs3/family1/33d09cd3ce6141e1bef1e4117dcae083 into e382088a27118f8b8a8b885e5576caaf/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/205ef15b36e44d64b5c5752cce4786d0_SeqId_44_) 2023-11-11 04:54:52,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o40umkrnfvaa48eerbl5ii05ajg6p76tb362rp2g1qpp09hs9fqv0qhq6rbmacs3/family1/33d09cd3ce6141e1bef1e4117dcae083 2023-11-11 04:54:52,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 04:54:52,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 04:54:52,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): e382088a27118f8b8a8b885e5576caaf/family1 is initiating minor compaction 2023-11-11 04:54:52,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3bc2373a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:52,974 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e382088a27118f8b8a8b885e5576caaf/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:52,974 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/803c1aa4b3684dcb9075ac2bf3565f43, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/42e5869212f44985a8b0920d29fa8998, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/f4e06ee3189d4736b2f3ba7e3181329c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/b9cb7fb23caf455690a3832eb0ce445c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/68076f69f1794c32bb35f42f5c3a93f8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/744e3608e6204836a287183831af2c33, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/9827deba856f4245b15773df9e358c89, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/cfc395d052664a11958e8d04c7c73c63, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/96c0e537c83f48ff9dc97638736ae10c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/205ef15b36e44d64b5c5752cce4786d0_SeqId_44_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp, totalSize=50.3 K 2023-11-11 04:54:52,974 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 803c1aa4b3684dcb9075ac2bf3565f43, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 04:54:52,974 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 42e5869212f44985a8b0920d29fa8998, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 04:54:52,974 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting f4e06ee3189d4736b2f3ba7e3181329c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 04:54:52,974 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting b9cb7fb23caf455690a3832eb0ce445c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 04:54:52,974 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 68076f69f1794c32bb35f42f5c3a93f8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 04:54:52,974 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 744e3608e6204836a287183831af2c33, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 04:54:52,974 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 9827deba856f4245b15773df9e358c89, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 04:54:52,974 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting cfc395d052664a11958e8d04c7c73c63, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 04:54:52,974 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 96c0e537c83f48ff9dc97638736ae10c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 04:54:52,975 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 205ef15b36e44d64b5c5752cce4786d0_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 04:54:52,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:52,976 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:52,978 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285bfd9420c3f240f88d8985732353476a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285bfd9420c3f240f88d8985732353476a 2023-11-11 04:54:52,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5bc33da791f4dda9378a627cb13281d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5bc33da791f4dda9378a627cb13281d 2023-11-11 04:54:52,980 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010824566fa7ee415187b3965a425adf05 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601010824566fa7ee415187b3965a425adf05 2023-11-11 04:54:52,981 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010322723add3f5b4fb6892974b0e2697345 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010322723add3f5b4fb6892974b0e2697345 2023-11-11 04:54:52,981 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-11 04:54:52,981 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-11 04:54:52,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:52,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:52,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:52,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:52,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:52,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:52,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:52,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:53,005 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): e382088a27118f8b8a8b885e5576caaf#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-11 04:54:53,821 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/6b02e4f9fb94457da5999caf3b29d8a2 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/6b02e4f9fb94457da5999caf3b29d8a2 2023-11-11 04:54:53,825 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120541e465b752bf45bd97f16eb5337a0df1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120541e465b752bf45bd97f16eb5337a0df1 2023-11-11 04:54:53,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:53,827 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e382088a27118f8b8a8b885e5576caaf/family1 of e382088a27118f8b8a8b885e5576caaf into 6b02e4f9fb94457da5999caf3b29d8a2(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:54:53,827 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:53,827 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699678492974; duration=0sec 2023-11-11 04:54:53,828 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:53,851 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/20f6b21ba9144db196fa7e2c730941b7 first=Optional[r00] last=Optional[r2] 2023-11-11 04:54:53,852 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/20f6b21ba9144db196fa7e2c730941b7}] 2023-11-11 04:54:53,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/20f6b21ba9144db196fa7e2c730941b7 for inclusion in e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:53,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-11 04:54:53,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:54:53,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:53,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/20f6b21ba9144db196fa7e2c730941b7 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2dbq9v5mc68vp59lf7l4t7or2nbrq1sgglrubtvaof5cn7u2ffltrjvdampsnrmo/family1/20f6b21ba9144db196fa7e2c730941b7 2023-11-11 04:54:53,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2dbq9v5mc68vp59lf7l4t7or2nbrq1sgglrubtvaof5cn7u2ffltrjvdampsnrmo/family1/20f6b21ba9144db196fa7e2c730941b7 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/60cdc07fed6c4d12ba318f5f9f72f4fd_SeqId_47_ 2023-11-11 04:54:53,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2dbq9v5mc68vp59lf7l4t7or2nbrq1sgglrubtvaof5cn7u2ffltrjvdampsnrmo/family1/20f6b21ba9144db196fa7e2c730941b7 into e382088a27118f8b8a8b885e5576caaf/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/60cdc07fed6c4d12ba318f5f9f72f4fd_SeqId_47_ - updating store file list. 2023-11-11 04:54:53,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/60cdc07fed6c4d12ba318f5f9f72f4fd_SeqId_47_ into e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:53,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2dbq9v5mc68vp59lf7l4t7or2nbrq1sgglrubtvaof5cn7u2ffltrjvdampsnrmo/family1/20f6b21ba9144db196fa7e2c730941b7 into e382088a27118f8b8a8b885e5576caaf/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/60cdc07fed6c4d12ba318f5f9f72f4fd_SeqId_47_) 2023-11-11 04:54:53,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2dbq9v5mc68vp59lf7l4t7or2nbrq1sgglrubtvaof5cn7u2ffltrjvdampsnrmo/family1/20f6b21ba9144db196fa7e2c730941b7 2023-11-11 04:54:53,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 04:54:53,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 04:54:53,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): e382088a27118f8b8a8b885e5576caaf/family1 is initiating minor compaction (all files) 2023-11-11 04:54:53,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3503d84c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:53,868 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e382088a27118f8b8a8b885e5576caaf/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:53,868 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/be362cf0edde4b21980a532d5ea3f988, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/6b02e4f9fb94457da5999caf3b29d8a2, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/60cdc07fed6c4d12ba318f5f9f72f4fd_SeqId_47_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp, totalSize=388.1 K 2023-11-11 04:54:53,869 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting be362cf0edde4b21980a532d5ea3f988, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828286 2023-11-11 04:54:53,869 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 6b02e4f9fb94457da5999caf3b29d8a2, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228286 2023-11-11 04:54:53,870 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:53,870 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 60cdc07fed6c4d12ba318f5f9f72f4fd_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878828286 2023-11-11 04:54:53,870 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:53,872 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113031fdf64ae089485bb26d35f3ee434ccd to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113031fdf64ae089485bb26d35f3ee434ccd 2023-11-11 04:54:53,873 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b1fd924124464b7fb98f7fb3c1fcb359 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b1fd924124464b7fb98f7fb3c1fcb359 2023-11-11 04:54:53,875 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120594f957caa2d74e5099106d7e2d8eab24 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120594f957caa2d74e5099106d7e2d8eab24 2023-11-11 04:54:53,875 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-11 04:54:53,875 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-11 04:54:53,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:53,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:53,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:53,877 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 04:54:53,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.7900 sec 2023-11-11 04:54:53,888 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): e382088a27118f8b8a8b885e5576caaf#family1#compaction#74 average throughput is 19.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-11 04:54:53,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/803c1aa4b3684dcb9075ac2bf3565f43, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/42e5869212f44985a8b0920d29fa8998, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/f4e06ee3189d4736b2f3ba7e3181329c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/b9cb7fb23caf455690a3832eb0ce445c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/68076f69f1794c32bb35f42f5c3a93f8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/744e3608e6204836a287183831af2c33, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/9827deba856f4245b15773df9e358c89, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/cfc395d052664a11958e8d04c7c73c63, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/96c0e537c83f48ff9dc97638736ae10c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/205ef15b36e44d64b5c5752cce4786d0_SeqId_44_] to archive 2023-11-11 04:54:53,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:53,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/803c1aa4b3684dcb9075ac2bf3565f43 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/803c1aa4b3684dcb9075ac2bf3565f43 2023-11-11 04:54:53,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/42e5869212f44985a8b0920d29fa8998 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/42e5869212f44985a8b0920d29fa8998 2023-11-11 04:54:53,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/f4e06ee3189d4736b2f3ba7e3181329c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/f4e06ee3189d4736b2f3ba7e3181329c 2023-11-11 04:54:53,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/b9cb7fb23caf455690a3832eb0ce445c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/b9cb7fb23caf455690a3832eb0ce445c 2023-11-11 04:54:53,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/68076f69f1794c32bb35f42f5c3a93f8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/68076f69f1794c32bb35f42f5c3a93f8 2023-11-11 04:54:53,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/744e3608e6204836a287183831af2c33 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/744e3608e6204836a287183831af2c33 2023-11-11 04:54:53,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/9827deba856f4245b15773df9e358c89 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/9827deba856f4245b15773df9e358c89 2023-11-11 04:54:53,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/cfc395d052664a11958e8d04c7c73c63 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/cfc395d052664a11958e8d04c7c73c63 2023-11-11 04:54:53,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/96c0e537c83f48ff9dc97638736ae10c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/96c0e537c83f48ff9dc97638736ae10c 2023-11-11 04:54:53,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/205ef15b36e44d64b5c5752cce4786d0_SeqId_44_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/205ef15b36e44d64b5c5752cce4786d0_SeqId_44_ 2023-11-11 04:54:53,960 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-11 04:54:53,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:54,370 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-11 04:54:54,371 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-11 04:54:54,371 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-11 04:54:54,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-11 04:54:54,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, REOPEN/MOVE}] 2023-11-11 04:54:54,376 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, REOPEN/MOVE 2023-11-11 04:54:54,376 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=e382088a27118f8b8a8b885e5576caaf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:54,376 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699678494376"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678494376"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678494376"}]},"ts":"1699678494376"} 2023-11-11 04:54:54,378 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure e382088a27118f8b8a8b885e5576caaf, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:54,529 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:54,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:54,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e382088a27118f8b8a8b885e5576caaf, disabling compactions & flushes 2023-11-11 04:54:54,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:55,105 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/.tmp/family1/85b2133145474c72b004e984d2426028 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/85b2133145474c72b004e984d2426028 2023-11-11 04:54:55,109 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e382088a27118f8b8a8b885e5576caaf/family1 of e382088a27118f8b8a8b885e5576caaf into 85b2133145474c72b004e984d2426028(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:54:55,109 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:55,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:55,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:55,109 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1699678493868; duration=1sec 2023-11-11 04:54:55,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. after waiting 0 ms 2023-11-11 04:54:55,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:55,109 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:54:55,112 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/be362cf0edde4b21980a532d5ea3f988, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/6b02e4f9fb94457da5999caf3b29d8a2, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/60cdc07fed6c4d12ba318f5f9f72f4fd_SeqId_47_] to archive 2023-11-11 04:54:55,113 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:55,114 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/be362cf0edde4b21980a532d5ea3f988 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/be362cf0edde4b21980a532d5ea3f988 2023-11-11 04:54:55,115 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/6b02e4f9fb94457da5999caf3b29d8a2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/6b02e4f9fb94457da5999caf3b29d8a2 2023-11-11 04:54:55,117 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/60cdc07fed6c4d12ba318f5f9f72f4fd_SeqId_47_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/60cdc07fed6c4d12ba318f5f9f72f4fd_SeqId_47_ 2023-11-11 04:54:55,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-11 04:54:55,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:55,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:55,121 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: e382088a27118f8b8a8b885e5576caaf to self. 2023-11-11 04:54:55,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:55,123 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=e382088a27118f8b8a8b885e5576caaf, regionState=CLOSED 2023-11-11 04:54:55,123 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699678495123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678495123"}]},"ts":"1699678495123"} 2023-11-11 04:54:55,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-11 04:54:55,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure e382088a27118f8b8a8b885e5576caaf, server=jenkins-hbase4.apache.org,43941,1699678403879 in 746 msec 2023-11-11 04:54:55,126 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=true 2023-11-11 04:54:55,276 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=e382088a27118f8b8a8b885e5576caaf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:55,276 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699678495276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678495276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678495276"}]},"ts":"1699678495276"} 2023-11-11 04:54:55,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure e382088a27118f8b8a8b885e5576caaf, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:55,428 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:55,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:55,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e382088a27118f8b8a8b885e5576caaf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:54:55,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:55,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:55,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:55,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:55,432 INFO [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:55,433 DEBUG [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:55,433 DEBUG [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:55,433 INFO [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e382088a27118f8b8a8b885e5576caaf columnFamilyName family1 2023-11-11 04:54:55,437 DEBUG [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/85b2133145474c72b004e984d2426028 2023-11-11 04:54:55,438 INFO [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] regionserver.HStore(310): Store=e382088a27118f8b8a8b885e5576caaf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:55,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:55,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:55,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:55,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e382088a27118f8b8a8b885e5576caaf; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58920328, jitterRate=-0.12201869487762451}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:54:55,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:55,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf., pid=63, masterSystemTime=1699678495428 2023-11-11 04:54:55,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:55,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:55,444 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=e382088a27118f8b8a8b885e5576caaf, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:55,444 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699678495444"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678495444"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678495444"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678495444"}]},"ts":"1699678495444"} 2023-11-11 04:54:55,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-11 04:54:55,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure e382088a27118f8b8a8b885e5576caaf, server=jenkins-hbase4.apache.org,43941,1699678403879 in 168 msec 2023-11-11 04:54:55,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-11 04:54:55,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, REOPEN/MOVE in 1.0710 sec 2023-11-11 04:54:55,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-11 04:54:55,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0750 sec 2023-11-11 04:54:55,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.4900 sec 2023-11-11 04:54:55,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-11 04:54:55,452 INFO [Listener at localhost/35271] compactions.TestMobCompactor(278): alter status finished 2023-11-11 04:54:55,453 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:55,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 04:54:55,454 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 04:54:55,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:55,455 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679095455 2023-11-11 04:54:55,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:54:55,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-11 04:54:55,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:55,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x6376f804 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:54:55,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47ecedb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:54:55,463 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:55,463 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:55,463 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:55,463 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:55,463 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:56,289 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285941508c2ec44c6ba443035cef6a0f8e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285941508c2ec44c6ba443035cef6a0f8e 2023-11-11 04:54:56,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:56,303 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:54:56,304 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36036, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:54:56,310 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:54:56,311 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:54:56,319 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/108c4a75e1664a1abae532e69482087f first=Optional[r05] last=Optional[r8] 2023-11-11 04:54:56,319 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=51 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/108c4a75e1664a1abae532e69482087f}] 2023-11-11 04:54:56,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/108c4a75e1664a1abae532e69482087f for inclusion in e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:56,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-11 04:54:56,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:54:56,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:56,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/108c4a75e1664a1abae532e69482087f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1nvgvgjpci3eh83hr37lau8msmmjfcql3jodjhjes3v911sblkmn2i4muestkkfp/family1/108c4a75e1664a1abae532e69482087f 2023-11-11 04:54:56,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1nvgvgjpci3eh83hr37lau8msmmjfcql3jodjhjes3v911sblkmn2i4muestkkfp/family1/108c4a75e1664a1abae532e69482087f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/67877af669cf487294e5a553f663b78f_SeqId_53_ 2023-11-11 04:54:56,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1nvgvgjpci3eh83hr37lau8msmmjfcql3jodjhjes3v911sblkmn2i4muestkkfp/family1/108c4a75e1664a1abae532e69482087f into e382088a27118f8b8a8b885e5576caaf/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/67877af669cf487294e5a553f663b78f_SeqId_53_ - updating store file list. 2023-11-11 04:54:56,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/67877af669cf487294e5a553f663b78f_SeqId_53_ into e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:56,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1nvgvgjpci3eh83hr37lau8msmmjfcql3jodjhjes3v911sblkmn2i4muestkkfp/family1/108c4a75e1664a1abae532e69482087f into e382088a27118f8b8a8b885e5576caaf/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/67877af669cf487294e5a553f663b78f_SeqId_53_) 2023-11-11 04:54:56,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1nvgvgjpci3eh83hr37lau8msmmjfcql3jodjhjes3v911sblkmn2i4muestkkfp/family1/108c4a75e1664a1abae532e69482087f 2023-11-11 04:54:56,334 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:56,335 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:54:56,336 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511205dc428d23923450ba33b50dff80f4129 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511205dc428d23923450ba33b50dff80f4129 2023-11-11 04:54:56,337 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e3c99d6a38de4cd4bdd9f170700a0b71 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e3c99d6a38de4cd4bdd9f170700a0b71 2023-11-11 04:54:56,337 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-11 04:54:56,337 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-11 04:54:56,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:56,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:56,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:56,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:56,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:56,338 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 04:54:56,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 886 msec 2023-11-11 04:54:56,388 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-11 04:54:56,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:56,797 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-11 04:54:56,798 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-11 04:54:56,798 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-11 04:54:56,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-11 04:54:56,802 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, REOPEN/MOVE}] 2023-11-11 04:54:56,802 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, REOPEN/MOVE 2023-11-11 04:54:56,803 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e382088a27118f8b8a8b885e5576caaf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:56,803 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699678496803"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678496803"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678496803"}]},"ts":"1699678496803"} 2023-11-11 04:54:56,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure e382088a27118f8b8a8b885e5576caaf, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:56,955 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:56,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:56,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e382088a27118f8b8a8b885e5576caaf, disabling compactions & flushes 2023-11-11 04:54:56,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:56,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:56,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. after waiting 0 ms 2023-11-11 04:54:56,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:56,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-11 04:54:56,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:56,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:56,963 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: e382088a27118f8b8a8b885e5576caaf to self. 2023-11-11 04:54:56,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:56,965 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e382088a27118f8b8a8b885e5576caaf, regionState=CLOSED 2023-11-11 04:54:56,965 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699678496965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678496965"}]},"ts":"1699678496965"} 2023-11-11 04:54:56,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-11 04:54:56,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure e382088a27118f8b8a8b885e5576caaf, server=jenkins-hbase4.apache.org,43941,1699678403879 in 162 msec 2023-11-11 04:54:56,967 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=true 2023-11-11 04:54:57,118 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e382088a27118f8b8a8b885e5576caaf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:57,118 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699678497118"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678497118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678497118"}]},"ts":"1699678497118"} 2023-11-11 04:54:57,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure e382088a27118f8b8a8b885e5576caaf, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:57,271 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:57,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:57,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e382088a27118f8b8a8b885e5576caaf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:54:57,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:57,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:57,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:57,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:57,275 INFO [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:57,276 DEBUG [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:57,276 DEBUG [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1 2023-11-11 04:54:57,276 INFO [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e382088a27118f8b8a8b885e5576caaf columnFamilyName family1 2023-11-11 04:54:57,281 DEBUG [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/67877af669cf487294e5a553f663b78f_SeqId_53_ 2023-11-11 04:54:57,284 DEBUG [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/family1/85b2133145474c72b004e984d2426028 2023-11-11 04:54:57,284 INFO [StoreOpener-e382088a27118f8b8a8b885e5576caaf-1] regionserver.HStore(310): Store=e382088a27118f8b8a8b885e5576caaf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:57,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:57,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:54:57,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e382088a27118f8b8a8b885e5576caaf; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64662710, jitterRate=-0.03645053505897522}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:54:57,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:54:57,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf., pid=69, masterSystemTime=1699678497271 2023-11-11 04:54:57,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:57,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:54:57,291 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e382088a27118f8b8a8b885e5576caaf, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:57,291 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699678497291"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678497291"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678497291"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678497291"}]},"ts":"1699678497291"} 2023-11-11 04:54:57,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-11 04:54:57,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure e382088a27118f8b8a8b885e5576caaf, server=jenkins-hbase4.apache.org,43941,1699678403879 in 174 msec 2023-11-11 04:54:57,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-11 04:54:57,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=e382088a27118f8b8a8b885e5576caaf, REOPEN/MOVE in 492 msec 2023-11-11 04:54:57,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-11 04:54:57,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 497 msec 2023-11-11 04:54:57,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 910 msec 2023-11-11 04:54:57,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-11 04:54:57,300 INFO [Listener at localhost/35271] compactions.TestMobCompactor(278): alter status finished 2023-11-11 04:54:57,301 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 04:54:57,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 04:54:57,303 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 04:54:57,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:57,303 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679097303 2023-11-11 04:54:57,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:54:57,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-11 04:54:57,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:57,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x4bd74e95 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:54:57,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1725e4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:54:57,310 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:57,310 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:57,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:57,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:57,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:57,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:57,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:57,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 04:54:57,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 04:54:57,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:54:57,312 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 04:54:57,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-11-11 04:54:57,359 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=257 (was 248) - Thread LEAK? -, OpenFileDescriptor=679 (was 650) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=138 (was 114) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1983 (was 2008) 2023-11-11 04:54:57,370 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=257, OpenFileDescriptor=679, MaxFileDescriptor=60000, SystemLoadAverage=138, ProcessCount=169, AvailableMemoryMB=1982 2023-11-11 04:54:57,373 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-11 04:54:57,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-11 04:54:57,375 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:54:57,376 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-11 04:54:57,376 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:54:57,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 04:54:57,378 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791 2023-11-11 04:54:57,378 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791 empty. 2023-11-11 04:54:57,378 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791 2023-11-11 04:54:57,378 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-11 04:54:57,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 04:54:57,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 04:54:57,786 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-11 04:54:57,787 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4d78d04bf5a97dda36785a8274268791, NAME => 'testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:54:57,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 04:54:58,193 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:58,193 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 4d78d04bf5a97dda36785a8274268791, disabling compactions & flushes 2023-11-11 04:54:58,193 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:54:58,193 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:54:58,193 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. after waiting 0 ms 2023-11-11 04:54:58,193 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:54:58,193 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:54:58,193 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 4d78d04bf5a97dda36785a8274268791: 2023-11-11 04:54:58,195 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:54:58,196 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699678498196"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678498196"}]},"ts":"1699678498196"} 2023-11-11 04:54:58,197 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 04:54:58,198 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:54:58,198 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678498198"}]},"ts":"1699678498198"} 2023-11-11 04:54:58,199 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-11 04:54:58,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=4d78d04bf5a97dda36785a8274268791, ASSIGN}] 2023-11-11 04:54:58,204 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=4d78d04bf5a97dda36785a8274268791, ASSIGN 2023-11-11 04:54:58,205 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=4d78d04bf5a97dda36785a8274268791, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:54:58,356 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=4d78d04bf5a97dda36785a8274268791, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:58,356 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699678498355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678498355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678498355"}]},"ts":"1699678498355"} 2023-11-11 04:54:58,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 4d78d04bf5a97dda36785a8274268791, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:54:58,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 04:54:58,508 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:58,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:54:58,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d78d04bf5a97dda36785a8274268791, NAME => 'testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:54:58,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-11 04:54:58,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-11 04:54:58,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 4d78d04bf5a97dda36785a8274268791 2023-11-11 04:54:58,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:54:58,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4d78d04bf5a97dda36785a8274268791 2023-11-11 04:54:58,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4d78d04bf5a97dda36785a8274268791 2023-11-11 04:54:58,514 INFO [StoreOpener-4d78d04bf5a97dda36785a8274268791-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d78d04bf5a97dda36785a8274268791 2023-11-11 04:54:58,515 DEBUG [StoreOpener-4d78d04bf5a97dda36785a8274268791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1 2023-11-11 04:54:58,515 DEBUG [StoreOpener-4d78d04bf5a97dda36785a8274268791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1 2023-11-11 04:54:58,516 INFO [StoreOpener-4d78d04bf5a97dda36785a8274268791-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d78d04bf5a97dda36785a8274268791 columnFamilyName f1 2023-11-11 04:54:58,517 INFO [StoreOpener-4d78d04bf5a97dda36785a8274268791-1] regionserver.HStore(310): Store=4d78d04bf5a97dda36785a8274268791/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:54:58,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791 2023-11-11 04:54:58,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791 2023-11-11 04:54:58,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4d78d04bf5a97dda36785a8274268791 2023-11-11 04:54:58,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:54:58,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4d78d04bf5a97dda36785a8274268791; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64075016, jitterRate=-0.045207858085632324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:54:58,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4d78d04bf5a97dda36785a8274268791: 2023-11-11 04:54:58,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791., pid=73, masterSystemTime=1699678498508 2023-11-11 04:54:58,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:54:58,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:54:58,524 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=4d78d04bf5a97dda36785a8274268791, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:54:58,524 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699678498524"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678498524"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678498524"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678498524"}]},"ts":"1699678498524"} 2023-11-11 04:54:58,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-11 04:54:58,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 4d78d04bf5a97dda36785a8274268791, server=jenkins-hbase4.apache.org,43941,1699678403879 in 168 msec 2023-11-11 04:54:58,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-11 04:54:58,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=4d78d04bf5a97dda36785a8274268791, ASSIGN in 323 msec 2023-11-11 04:54:58,527 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:54:58,527 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678498527"}]},"ts":"1699678498527"} 2023-11-11 04:54:58,528 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-11 04:54:58,530 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:54:58,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1560 sec 2023-11-11 04:54:59,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 04:54:59,481 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-11 04:54:59,482 DEBUG [Listener at localhost/35271] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-11 04:54:59,483 INFO [Listener at localhost/35271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-11 04:54:59,486 INFO [Listener at localhost/35271] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-11 04:54:59,486 INFO [Listener at localhost/35271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-11 04:54:59,487 INFO [Listener at localhost/35271] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-11 04:54:59,491 INFO [Listener at localhost/35271] regionserver.HRegion(2745): Flushing 4d78d04bf5a97dda36785a8274268791 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-11 04:54:59,903 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111147626b001564efb8e7ff97cec2ee3ca to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231111147626b001564efb8e7ff97cec2ee3ca 2023-11-11 04:55:00,308 INFO [Listener at localhost/35271] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/.tmp/f1/fbae761239fc4aa89f1368de20348a54 2023-11-11 04:55:00,313 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/.tmp/f1/fbae761239fc4aa89f1368de20348a54 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54 2023-11-11 04:55:00,318 INFO [Listener at localhost/35271] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54, entries=1, sequenceid=5, filesize=4.9 K 2023-11-11 04:55:00,319 INFO [Listener at localhost/35271] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 4d78d04bf5a97dda36785a8274268791 in 828ms, sequenceid=5, compaction requested=false 2023-11-11 04:55:00,319 DEBUG [Listener at localhost/35271] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-11 04:55:00,320 DEBUG [Listener at localhost/35271] regionserver.HRegion(2446): Flush status journal for 4d78d04bf5a97dda36785a8274268791: 2023-11-11 04:55:00,321 INFO [Listener at localhost/35271] regionserver.HRegion(2745): Flushing 4d78d04bf5a97dda36785a8274268791 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-11 04:55:00,697 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:55:00,697 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-11 04:55:00,697 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6376f804 to 127.0.0.1:61842 2023-11-11 04:55:00,697 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:00,698 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bd74e95 to 127.0.0.1:61842 2023-11-11 04:55:00,698 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:00,699 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:55:00,699 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c3e97ee to 127.0.0.1:61842 2023-11-11 04:55:00,699 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:00,699 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6361e36f to 127.0.0.1:61842 2023-11-11 04:55:00,699 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:00,699 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:55:00,699 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:55:00,699 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20823871 to 127.0.0.1:61842 2023-11-11 04:55:00,700 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:00,700 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:55:00,700 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42a33be4 to 127.0.0.1:61842 2023-11-11 04:55:00,700 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:00,700 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:55:00,701 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c301485 to 127.0.0.1:61842 2023-11-11 04:55:00,701 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:00,734 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111150f9bbef54bb46a58f0143c6e52c45ef to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111150f9bbef54bb46a58f0143c6e52c45ef 2023-11-11 04:55:01,143 INFO [Listener at localhost/35271] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/.tmp/f1/d07c50bfda7741eba13cf59f2eca9ee4 2023-11-11 04:55:01,147 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/.tmp/f1/d07c50bfda7741eba13cf59f2eca9ee4 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4 2023-11-11 04:55:01,150 INFO [Listener at localhost/35271] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4, entries=1, sequenceid=9, filesize=4.9 K 2023-11-11 04:55:01,151 INFO [Listener at localhost/35271] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 4d78d04bf5a97dda36785a8274268791 in 830ms, sequenceid=9, compaction requested=false 2023-11-11 04:55:01,151 DEBUG [Listener at localhost/35271] regionserver.HRegion(2446): Flush status journal for 4d78d04bf5a97dda36785a8274268791: 2023-11-11 04:55:01,153 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-11 04:55:01,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-11 04:55:01,155 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-11 04:55:01,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:55:01,155 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679101155 2023-11-11 04:55:01,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 04:55:01,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-11 04:55:01,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-11 04:55:01,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x5feecb60 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:55:01,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c7d76f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:55:01,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231111 for table='testGetAfterCompaction' and column='f1' 2023-11-11 04:55:01,204 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,204 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,255 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,255 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,306 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,306 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,356 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,356 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,407 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,407 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,458 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,458 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,509 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,509 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,560 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,560 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,611 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,611 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,662 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,662 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,712 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,712 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,763 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,763 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,814 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,814 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,865 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,865 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,916 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,916 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,966 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,967 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:01,987 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311116abc03f8086c4d3ca278bf73116babd2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311116abc03f8086c4d3ca278bf73116babd2 2023-11-11 04:55:01,989 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testGetAfterCompaction' column='f1' 2023-11-11 04:55:02,003 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:55:02,004 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:55:02,012 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:55:02,013 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:55:02,017 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,017 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,023 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/f1/e7048dc3002049d19fe5f661a3671473 first=Optional[r1] last=Optional[r2] 2023-11-11 04:55:02,023 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{f1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/f1/e7048dc3002049d19fe5f661a3671473}] 2023-11-11 04:55:02,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/f1/e7048dc3002049d19fe5f661a3671473 for inclusion in 4d78d04bf5a97dda36785a8274268791/f1 2023-11-11 04:55:02,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-11 04:55:02,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:55:02,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 4d78d04bf5a97dda36785a8274268791: 2023-11-11 04:55:02,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/f1/e7048dc3002049d19fe5f661a3671473 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testGetAfterCompaction__93lahqtgd6jcqjj81upbibil90e85crsf8hgb2d3certh5iu2ihsoqi0ap6s7fi6/f1/e7048dc3002049d19fe5f661a3671473 2023-11-11 04:55:02,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testGetAfterCompaction__93lahqtgd6jcqjj81upbibil90e85crsf8hgb2d3certh5iu2ihsoqi0ap6s7fi6/f1/e7048dc3002049d19fe5f661a3671473 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_ 2023-11-11 04:55:02,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testGetAfterCompaction__93lahqtgd6jcqjj81upbibil90e85crsf8hgb2d3certh5iu2ihsoqi0ap6s7fi6/f1/e7048dc3002049d19fe5f661a3671473 into 4d78d04bf5a97dda36785a8274268791/f1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_ - updating store file list. 2023-11-11 04:55:02,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_ into 4d78d04bf5a97dda36785a8274268791/f1 2023-11-11 04:55:02,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testGetAfterCompaction__93lahqtgd6jcqjj81upbibil90e85crsf8hgb2d3certh5iu2ihsoqi0ap6s7fi6/f1/e7048dc3002049d19fe5f661a3671473 into 4d78d04bf5a97dda36785a8274268791/f1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_) 2023-11-11 04:55:02,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testGetAfterCompaction__93lahqtgd6jcqjj81upbibil90e85crsf8hgb2d3certh5iu2ihsoqi0ap6s7fi6/f1/e7048dc3002049d19fe5f661a3671473 2023-11-11 04:55:02,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): 4d78d04bf5a97dda36785a8274268791/f1 is initiating minor compaction 2023-11-11 04:55:02,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4fb8bb4c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:55:02,042 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4d78d04bf5a97dda36785a8274268791/f1 in testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:55:02,042 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/.tmp, totalSize=10.0 K 2023-11-11 04:55:02,043 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting d07c50bfda7741eba13cf59f2eca9ee4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 04:55:02,043 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting d666e3d7802945618bf51eece4eed220_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 04:55:02,061 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testGetAfterCompaction' column='f1' 2023-11-11 04:55:02,062 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:02,066 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231111147626b001564efb8e7ff97cec2ee3ca to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231111147626b001564efb8e7ff97cec2ee3ca 2023-11-11 04:55:02,068 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111150f9bbef54bb46a58f0143c6e52c45ef to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111150f9bbef54bb46a58f0143c6e52c45ef 2023-11-11 04:55:02,068 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-11 04:55:02,068 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231111' 2023-11-11 04:55:02,068 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4d78d04bf5a97dda36785a8274268791#f1#compaction#77 average throughput is 0.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-11 04:55:02,068 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,068 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699678501983; access_time=1699678501174; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 04:55:02,068 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231111 for table='testGetAfterCompaction' and column='f1' 2023-11-11 04:55:02,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-11 04:55:02,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:55:02,070 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-11 04:55:02,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 917 msec 2023-11-11 04:55:02,078 DEBUG [Listener at localhost/35271] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-11 04:55:02,086 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-11 04:55:02,086 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43941] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:55:02,087 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-11 04:55:02,087 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-11 04:55:02,087 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43941] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-11 04:55:02,087 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43941] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. because compaction request was cancelled 2023-11-11 04:55:02,139 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,139 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699678501983; access_time=1699678501174; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 04:55:02,139 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,190 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,190 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699678501983; access_time=1699678501174; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 04:55:02,190 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,240 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,241 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699678501983; access_time=1699678501174; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 04:55:02,241 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,291 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,291 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699678501983; access_time=1699678501174; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 04:55:02,292 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,342 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,342 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699678501983; access_time=1699678501174; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 04:55:02,342 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,393 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,393 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699678501983; access_time=1699678501174; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 04:55:02,393 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,444 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,444 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699678501983; access_time=1699678501174; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 04:55:02,444 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,494 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/.tmp/f1/a8aec3760aff40f5945fe9d05c3fa626 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/a8aec3760aff40f5945fe9d05c3fa626 2023-11-11 04:55:02,495 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/a8aec3760aff40f5945fe9d05c3fa626; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699678502489; access_time=1699678502048; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,495 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,495 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699678501983; access_time=1699678501174; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 04:55:02,495 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,498 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 4d78d04bf5a97dda36785a8274268791/f1 of 4d78d04bf5a97dda36785a8274268791 into a8aec3760aff40f5945fe9d05c3fa626(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:55:02,498 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4d78d04bf5a97dda36785a8274268791: 2023-11-11 04:55:02,498 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1699678502042; duration=0sec 2023-11-11 04:55:02,498 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:55:02,546 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/a8aec3760aff40f5945fe9d05c3fa626; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699678502489; access_time=1699678502048; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,546 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,546 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699678501983; access_time=1699678501174; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 04:55:02,546 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,596 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/a8aec3760aff40f5945fe9d05c3fa626; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699678502489; access_time=1699678502048; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,596 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678501142; access_time=1699678500323; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,596 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699678501983; access_time=1699678501174; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 04:55:02,597 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_] to archive 2023-11-11 04:55:02,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:02,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d07c50bfda7741eba13cf59f2eca9ee4 2023-11-11 04:55:02,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/d666e3d7802945618bf51eece4eed220_SeqId_12_ 2023-11-11 04:55:02,647 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/a8aec3760aff40f5945fe9d05c3fa626; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699678502489; access_time=1699678502048; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,647 INFO [Listener at localhost/35271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699678500308; access_time=1699678499493; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 04:55:02,762 INFO [Listener at localhost/35271] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-11 04:55:02,766 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-11 04:55:02,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-11 04:55:02,774 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678502774"}]},"ts":"1699678502774"} 2023-11-11 04:55:02,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-11 04:55:02,776 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-11 04:55:02,778 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-11 04:55:02,779 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=4d78d04bf5a97dda36785a8274268791, UNASSIGN}] 2023-11-11 04:55:02,780 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=4d78d04bf5a97dda36785a8274268791, UNASSIGN 2023-11-11 04:55:02,781 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4d78d04bf5a97dda36785a8274268791, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:02,781 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699678502781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678502781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678502781"}]},"ts":"1699678502781"} 2023-11-11 04:55:02,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 4d78d04bf5a97dda36785a8274268791, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:02,822 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-11 04:55:02,822 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-11-11 04:55:02,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-11 04:55:02,933 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:02,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4d78d04bf5a97dda36785a8274268791 2023-11-11 04:55:02,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4d78d04bf5a97dda36785a8274268791, disabling compactions & flushes 2023-11-11 04:55:02,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:55:02,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:55:02,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. after waiting 0 ms 2023-11-11 04:55:02,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:55:02,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-11 04:55:02,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-11 04:55:02,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791. 2023-11-11 04:55:02,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4d78d04bf5a97dda36785a8274268791: 2023-11-11 04:55:02,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4d78d04bf5a97dda36785a8274268791 2023-11-11 04:55:02,940 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4d78d04bf5a97dda36785a8274268791, regionState=CLOSED 2023-11-11 04:55:02,940 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699678502940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678502940"}]},"ts":"1699678502940"} 2023-11-11 04:55:02,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-11 04:55:02,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 4d78d04bf5a97dda36785a8274268791, server=jenkins-hbase4.apache.org,43941,1699678403879 in 159 msec 2023-11-11 04:55:02,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-11 04:55:02,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=4d78d04bf5a97dda36785a8274268791, UNASSIGN in 164 msec 2023-11-11 04:55:02,944 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678502944"}]},"ts":"1699678502944"} 2023-11-11 04:55:02,945 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-11 04:55:02,946 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-11 04:55:02,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 179 msec 2023-11-11 04:55:03,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-11 04:55:03,077 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-11 04:55:03,082 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-11 04:55:03,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 04:55:03,089 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 04:55:03,090 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 04:55:03,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-11 04:55:03,093 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791 2023-11-11 04:55:03,095 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1, FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/recovered.edits] 2023-11-11 04:55:03,098 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/a8aec3760aff40f5945fe9d05c3fa626 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/a8aec3760aff40f5945fe9d05c3fa626 2023-11-11 04:55:03,099 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/f1/fbae761239fc4aa89f1368de20348a54 2023-11-11 04:55:03,102 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/recovered.edits/15.seqid to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791/recovered.edits/15.seqid 2023-11-11 04:55:03,103 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testGetAfterCompaction/4d78d04bf5a97dda36785a8274268791 2023-11-11 04:55:03,103 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-11 04:55:03,103 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-11 04:55:03,104 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-11 04:55:03,107 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311116abc03f8086c4d3ca278bf73116babd2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311116abc03f8086c4d3ca278bf73116babd2 2023-11-11 04:55:03,107 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-11 04:55:03,109 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 04:55:03,137 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-11 04:55:03,139 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-11 04:55:03,140 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 04:55:03,140 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-11 04:55:03,141 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699678503140"}]},"ts":"9223372036854775807"} 2023-11-11 04:55:03,142 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-11 04:55:03,142 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4d78d04bf5a97dda36785a8274268791, NAME => 'testGetAfterCompaction,,1699678497373.4d78d04bf5a97dda36785a8274268791.', STARTKEY => '', ENDKEY => ''}] 2023-11-11 04:55:03,142 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-11 04:55:03,142 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1699678503142"}]},"ts":"9223372036854775807"} 2023-11-11 04:55:03,143 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-11 04:55:03,145 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 04:55:03,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 62 msec 2023-11-11 04:55:03,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-11 04:55:03,192 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-11 04:55:03,204 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=240 (was 257), OpenFileDescriptor=625 (was 679), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=135 (was 138), ProcessCount=169 (was 169), AvailableMemoryMB=1954 (was 1982) 2023-11-11 04:55:03,215 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=240, OpenFileDescriptor=625, MaxFileDescriptor=60000, SystemLoadAverage=135, ProcessCount=169, AvailableMemoryMB=1953 2023-11-11 04:55:03,216 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-11 04:55:03,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-11 04:55:03,218 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:55:03,218 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-11 04:55:03,219 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:55:03,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 04:55:03,221 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:03,221 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:03,222 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8 empty. 2023-11-11 04:55:03,222 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:03,223 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0 empty. 2023-11-11 04:55:03,223 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:03,223 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed empty. 2023-11-11 04:55:03,223 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:03,223 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:03,223 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-11 04:55:03,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 04:55:03,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 04:55:03,631 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-11 04:55:03,632 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 33b07a4e052e234a667f8fd20a21a8a8, NAME => 'testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:55:03,632 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 2e6918dc58f4aaaece8729bb59a834ed, NAME => 'testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:55:03,633 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => edd1396e4f13db5121a27e2b760689b0, NAME => 'testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:55:03,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:03,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 2e6918dc58f4aaaece8729bb59a834ed, disabling compactions & flushes 2023-11-11 04:55:03,649 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:03,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:03,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. after waiting 0 ms 2023-11-11 04:55:03,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:03,649 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:03,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:03,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 04:55:04,041 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:04,041 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 33b07a4e052e234a667f8fd20a21a8a8, disabling compactions & flushes 2023-11-11 04:55:04,041 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:04,041 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:04,041 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. after waiting 0 ms 2023-11-11 04:55:04,041 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:04,041 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:04,041 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:04,049 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:04,049 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing edd1396e4f13db5121a27e2b760689b0, disabling compactions & flushes 2023-11-11 04:55:04,049 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:04,049 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:04,049 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. after waiting 0 ms 2023-11-11 04:55:04,049 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:04,049 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:04,049 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:04,051 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:55:04,052 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678504052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678504052"}]},"ts":"1699678504052"} 2023-11-11 04:55:04,052 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678504052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678504052"}]},"ts":"1699678504052"} 2023-11-11 04:55:04,052 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678504052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678504052"}]},"ts":"1699678504052"} 2023-11-11 04:55:04,054 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-11 04:55:04,054 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:55:04,055 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678504055"}]},"ts":"1699678504055"} 2023-11-11 04:55:04,056 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-11 04:55:04,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=33b07a4e052e234a667f8fd20a21a8a8, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=edd1396e4f13db5121a27e2b760689b0, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2e6918dc58f4aaaece8729bb59a834ed, ASSIGN}] 2023-11-11 04:55:04,063 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2e6918dc58f4aaaece8729bb59a834ed, ASSIGN 2023-11-11 04:55:04,063 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=edd1396e4f13db5121a27e2b760689b0, ASSIGN 2023-11-11 04:55:04,063 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=33b07a4e052e234a667f8fd20a21a8a8, ASSIGN 2023-11-11 04:55:04,063 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2e6918dc58f4aaaece8729bb59a834ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:55:04,063 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=edd1396e4f13db5121a27e2b760689b0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:55:04,064 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=33b07a4e052e234a667f8fd20a21a8a8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:55:04,215 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=33b07a4e052e234a667f8fd20a21a8a8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:04,215 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=2e6918dc58f4aaaece8729bb59a834ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:04,215 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=edd1396e4f13db5121a27e2b760689b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:04,215 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678504215"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678504215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678504215"}]},"ts":"1699678504215"} 2023-11-11 04:55:04,215 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678504215"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678504215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678504215"}]},"ts":"1699678504215"} 2023-11-11 04:55:04,215 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678504215"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678504215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678504215"}]},"ts":"1699678504215"} 2023-11-11 04:55:04,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure 2e6918dc58f4aaaece8729bb59a834ed, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:04,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure 33b07a4e052e234a667f8fd20a21a8a8, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:04,220 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure edd1396e4f13db5121a27e2b760689b0, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:04,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 04:55:04,375 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:04,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:04,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 33b07a4e052e234a667f8fd20a21a8a8, NAME => 'testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.', STARTKEY => '', ENDKEY => '1'} 2023-11-11 04:55:04,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:04,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:04,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:04,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:04,381 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:04,382 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1 2023-11-11 04:55:04,382 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1 2023-11-11 04:55:04,383 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33b07a4e052e234a667f8fd20a21a8a8 columnFamilyName family1 2023-11-11 04:55:04,384 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(310): Store=33b07a4e052e234a667f8fd20a21a8a8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:04,385 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:04,386 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2 2023-11-11 04:55:04,386 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2 2023-11-11 04:55:04,387 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33b07a4e052e234a667f8fd20a21a8a8 columnFamilyName family2 2023-11-11 04:55:04,388 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(310): Store=33b07a4e052e234a667f8fd20a21a8a8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:04,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:04,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:04,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:04,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:04,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:55:04,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 33b07a4e052e234a667f8fd20a21a8a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66953505, jitterRate=-0.002315029501914978}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:04,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:04,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8., pid=84, masterSystemTime=1699678504375 2023-11-11 04:55:04,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:04,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:04,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:04,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => edd1396e4f13db5121a27e2b760689b0, NAME => 'testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.', STARTKEY => '1', ENDKEY => '2'} 2023-11-11 04:55:04,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:04,396 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=33b07a4e052e234a667f8fd20a21a8a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:04,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:04,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:04,396 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678504396"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678504396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678504396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678504396"}]},"ts":"1699678504396"} 2023-11-11 04:55:04,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:04,397 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:04,398 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1 2023-11-11 04:55:04,398 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1 2023-11-11 04:55:04,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=80 2023-11-11 04:55:04,399 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region edd1396e4f13db5121a27e2b760689b0 columnFamilyName family1 2023-11-11 04:55:04,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure 33b07a4e052e234a667f8fd20a21a8a8, server=jenkins-hbase4.apache.org,43941,1699678403879 in 179 msec 2023-11-11 04:55:04,399 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(310): Store=edd1396e4f13db5121a27e2b760689b0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:04,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=33b07a4e052e234a667f8fd20a21a8a8, ASSIGN in 339 msec 2023-11-11 04:55:04,400 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:04,401 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2 2023-11-11 04:55:04,401 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2 2023-11-11 04:55:04,401 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region edd1396e4f13db5121a27e2b760689b0 columnFamilyName family2 2023-11-11 04:55:04,401 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(310): Store=edd1396e4f13db5121a27e2b760689b0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:04,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:04,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:04,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:04,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:04,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:55:04,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened edd1396e4f13db5121a27e2b760689b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71252945, jitterRate=0.06175161898136139}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:04,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:04,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0., pid=85, masterSystemTime=1699678504375 2023-11-11 04:55:04,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:04,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:04,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:04,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2e6918dc58f4aaaece8729bb59a834ed, NAME => 'testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.', STARTKEY => '2', ENDKEY => ''} 2023-11-11 04:55:04,408 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=edd1396e4f13db5121a27e2b760689b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:04,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:04,408 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678504408"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678504408"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678504408"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678504408"}]},"ts":"1699678504408"} 2023-11-11 04:55:04,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:04,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:04,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:04,409 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:04,410 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1 2023-11-11 04:55:04,410 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1 2023-11-11 04:55:04,411 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=81 2023-11-11 04:55:04,411 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure edd1396e4f13db5121a27e2b760689b0, server=jenkins-hbase4.apache.org,43941,1699678403879 in 191 msec 2023-11-11 04:55:04,411 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e6918dc58f4aaaece8729bb59a834ed columnFamilyName family1 2023-11-11 04:55:04,411 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(310): Store=2e6918dc58f4aaaece8729bb59a834ed/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:04,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=edd1396e4f13db5121a27e2b760689b0, ASSIGN in 351 msec 2023-11-11 04:55:04,412 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:04,413 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2 2023-11-11 04:55:04,413 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2 2023-11-11 04:55:04,413 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e6918dc58f4aaaece8729bb59a834ed columnFamilyName family2 2023-11-11 04:55:04,413 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(310): Store=2e6918dc58f4aaaece8729bb59a834ed/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:04,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:04,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:04,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:04,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:04,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:55:04,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2e6918dc58f4aaaece8729bb59a834ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71535426, jitterRate=0.06596091389656067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:04,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:04,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed., pid=83, masterSystemTime=1699678504375 2023-11-11 04:55:04,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:04,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:04,421 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=2e6918dc58f4aaaece8729bb59a834ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:04,421 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678504421"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678504421"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678504421"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678504421"}]},"ts":"1699678504421"} 2023-11-11 04:55:04,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=82 2023-11-11 04:55:04,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure 2e6918dc58f4aaaece8729bb59a834ed, server=jenkins-hbase4.apache.org,43941,1699678403879 in 205 msec 2023-11-11 04:55:04,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=79 2023-11-11 04:55:04,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2e6918dc58f4aaaece8729bb59a834ed, ASSIGN in 362 msec 2023-11-11 04:55:04,425 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:55:04,425 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678504425"}]},"ts":"1699678504425"} 2023-11-11 04:55:04,426 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-11 04:55:04,428 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:55:04,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2120 sec 2023-11-11 04:55:05,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 04:55:05,324 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-11 04:55:05,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:05,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:05,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:05,335 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:05,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-11 04:55:05,337 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-11 04:55:05,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:05,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-11 04:55:05,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-11 04:55:05,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:05,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:05,339 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:05,339 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:05,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:05,339 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:05,339 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:05,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:05,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:05,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:05,340 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-11 04:55:05,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-11 04:55:05,340 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-11 04:55:05,340 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:05,340 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-11 04:55:05,341 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:05,341 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:05,341 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. started... 2023-11-11 04:55:05,341 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:05,341 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:05,341 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:05,341 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing edd1396e4f13db5121a27e2b760689b0 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 04:55:05,341 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. started... 2023-11-11 04:55:05,341 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. started... 2023-11-11 04:55:05,342 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2e6918dc58f4aaaece8729bb59a834ed 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 04:55:05,342 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 33b07a4e052e234a667f8fd20a21a8a8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 04:55:05,755 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311110fdb441fa47c41deaca27867a85c5b93 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311110fdb441fa47c41deaca27867a85c5b93 2023-11-11 04:55:05,755 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311114c27dcb5b95749b5b8fec200b71ee172 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311114c27dcb5b95749b5b8fec200b71ee172 2023-11-11 04:55:05,755 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111caed6a357ed943a28bdb4e86dc99a72c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111caed6a357ed943a28bdb4e86dc99a72c 2023-11-11 04:55:06,161 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/130eb83344b043c39e617cf762c1384d 2023-11-11 04:55:06,162 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/16405ac9a365499f9f5faf021b56d1cf 2023-11-11 04:55:06,162 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/f56fd7a3395d43f0a8a4b805c83f468f 2023-11-11 04:55:06,177 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111391e5c23ef08445b95fb7b969e5915e6 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111391e5c23ef08445b95fb7b969e5915e6 2023-11-11 04:55:06,181 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/19b17102fd1e4465825162c0692e474d 2023-11-11 04:55:06,184 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/16405ac9a365499f9f5faf021b56d1cf as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/16405ac9a365499f9f5faf021b56d1cf 2023-11-11 04:55:06,188 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/16405ac9a365499f9f5faf021b56d1cf, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 04:55:06,188 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/19b17102fd1e4465825162c0692e474d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/19b17102fd1e4465825162c0692e474d 2023-11-11 04:55:06,192 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/19b17102fd1e4465825162c0692e474d, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 04:55:06,192 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2e6918dc58f4aaaece8729bb59a834ed in 850ms, sequenceid=5, compaction requested=false 2023-11-11 04:55:06,193 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-11 04:55:06,193 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:06,193 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:06,193 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:06,577 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111bced2b1f25574d1bb7bae52210739243 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111bced2b1f25574d1bb7bae52210739243 2023-11-11 04:55:06,577 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311119571cdd86be446f181b56f834cee3fb3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311119571cdd86be446f181b56f834cee3fb3 2023-11-11 04:55:06,982 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/0c94b698495645a380e12a9e6c768bea 2023-11-11 04:55:06,982 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/b99159def6524322a8bb631204eb429f 2023-11-11 04:55:06,986 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/f56fd7a3395d43f0a8a4b805c83f468f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f56fd7a3395d43f0a8a4b805c83f468f 2023-11-11 04:55:06,987 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/130eb83344b043c39e617cf762c1384d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/130eb83344b043c39e617cf762c1384d 2023-11-11 04:55:06,990 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f56fd7a3395d43f0a8a4b805c83f468f, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 04:55:06,990 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/130eb83344b043c39e617cf762c1384d, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 04:55:06,991 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/0c94b698495645a380e12a9e6c768bea as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/0c94b698495645a380e12a9e6c768bea 2023-11-11 04:55:06,991 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/b99159def6524322a8bb631204eb429f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/b99159def6524322a8bb631204eb429f 2023-11-11 04:55:06,995 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/0c94b698495645a380e12a9e6c768bea, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 04:55:06,995 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/b99159def6524322a8bb631204eb429f, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 04:55:06,996 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 33b07a4e052e234a667f8fd20a21a8a8 in 1654ms, sequenceid=5, compaction requested=false 2023-11-11 04:55:06,996 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:06,996 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:06,996 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for edd1396e4f13db5121a27e2b760689b0 in 1655ms, sequenceid=5, compaction requested=false 2023-11-11 04:55:06,996 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:06,996 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:06,996 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:06,997 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:06,997 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:06,997 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:06,997 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-11 04:55:06,997 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-11 04:55:06,998 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:06,998 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:06,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:06,999 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:06,999 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:07,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-11 04:55:07,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ba6b64[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:07,000 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-11 04:55:07,000 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:07,002 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:07,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:07,002 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-11 04:55:07,002 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-11 04:55:07,002 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:07,002 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,002 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:07,004 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-11 04:55:07,004 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:07,004 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,004 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-11 04:55:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:07,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:07,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:07,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-11 04:55:07,007 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-11 04:55:07,007 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:07,007 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:07,007 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-11 04:55:07,007 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:07,008 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:07,008 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:07,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:07,008 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:07,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:07,009 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:07,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:07,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,010 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:07,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:07,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:07,013 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-11 04:55:07,013 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:07,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-11 04:55:07,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:07,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:07,013 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:07,013 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:07,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:07,013 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:07,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:07,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:07,013 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:07,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:07,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:07,113 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:07,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:07,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:07,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:07,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:07,118 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:07,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:07,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-11 04:55:07,120 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-11 04:55:07,120 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:07,120 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-11 04:55:07,120 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-11 04:55:07,120 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:07,120 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:07,122 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:07,122 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:07,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:07,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:07,122 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:07,122 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:07,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:07,123 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-11 04:55:07,123 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-11 04:55:07,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-11 04:55:07,123 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-11 04:55:07,123 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:07,123 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-11 04:55:07,124 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:07,124 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. started... 2023-11-11 04:55:07,124 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:07,124 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:07,124 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:07,124 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:07,124 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. started... 2023-11-11 04:55:07,124 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. started... 2023-11-11 04:55:07,124 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing edd1396e4f13db5121a27e2b760689b0 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 04:55:07,124 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 33b07a4e052e234a667f8fd20a21a8a8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 04:55:07,124 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2e6918dc58f4aaaece8729bb59a834ed 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 04:55:07,150 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111e7d88fe71d9d44c4b10c40d15ee58632 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111e7d88fe71d9d44c4b10c40d15ee58632 2023-11-11 04:55:07,150 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311114672dc24b4d444349fca18ab7ab4a928 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311114672dc24b4d444349fca18ab7ab4a928 2023-11-11 04:55:07,540 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111115b461efbf6c454d9c6d99ee8e1a99b8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111115b461efbf6c454d9c6d99ee8e1a99b8 2023-11-11 04:55:07,554 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/28367240a6564659b26a1497ebdc745c 2023-11-11 04:55:07,555 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/d13db27086754f10abfc2f8b9784bba2 2023-11-11 04:55:07,945 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/56070528552f473f85235d97f88da6f9 2023-11-11 04:55:07,970 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111573dc72285f14e2cbffb3118ac5db671 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111573dc72285f14e2cbffb3118ac5db671 2023-11-11 04:55:07,970 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111289716d95b0e459788936174978b408b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111289716d95b0e459788936174978b408b 2023-11-11 04:55:07,974 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/ad560bd65d1d41a9b263affab1c67608 2023-11-11 04:55:07,978 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/d13db27086754f10abfc2f8b9784bba2 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/d13db27086754f10abfc2f8b9784bba2 2023-11-11 04:55:07,982 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/d13db27086754f10abfc2f8b9784bba2, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 04:55:07,982 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/ad560bd65d1d41a9b263affab1c67608 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/ad560bd65d1d41a9b263affab1c67608 2023-11-11 04:55:07,985 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/ad560bd65d1d41a9b263affab1c67608, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 04:55:07,986 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for edd1396e4f13db5121a27e2b760689b0 in 862ms, sequenceid=9, compaction requested=false 2023-11-11 04:55:07,986 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:07,986 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:07,986 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:08,359 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311115019de6342cf4348a988f26801b02be9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311115019de6342cf4348a988f26801b02be9 2023-11-11 04:55:08,375 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/a2276e6d835a4fc9844f3864abb06013 2023-11-11 04:55:08,378 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/28367240a6564659b26a1497ebdc745c as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/28367240a6564659b26a1497ebdc745c 2023-11-11 04:55:08,382 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/28367240a6564659b26a1497ebdc745c, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 04:55:08,382 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/a2276e6d835a4fc9844f3864abb06013 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a2276e6d835a4fc9844f3864abb06013 2023-11-11 04:55:08,386 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a2276e6d835a4fc9844f3864abb06013, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 04:55:08,387 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2e6918dc58f4aaaece8729bb59a834ed in 1263ms, sequenceid=9, compaction requested=false 2023-11-11 04:55:08,387 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:08,387 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:08,387 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:08,440 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:55:08,764 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/64f9c35100864faf98ee944976b8d698 2023-11-11 04:55:08,769 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/56070528552f473f85235d97f88da6f9 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/56070528552f473f85235d97f88da6f9 2023-11-11 04:55:08,773 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/56070528552f473f85235d97f88da6f9, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 04:55:08,774 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/64f9c35100864faf98ee944976b8d698 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/64f9c35100864faf98ee944976b8d698 2023-11-11 04:55:08,778 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/64f9c35100864faf98ee944976b8d698, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 04:55:08,779 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 33b07a4e052e234a667f8fd20a21a8a8 in 1655ms, sequenceid=9, compaction requested=false 2023-11-11 04:55:08,779 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:08,779 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:08,779 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:08,779 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:08,779 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,779 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-11 04:55:08,779 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-11 04:55:08,783 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,783 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:08,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:08,784 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:08,784 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:08,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:08,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:08,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:08,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:08,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-11 04:55:08,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24cdf260[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:08,785 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-11 04:55:08,785 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:08,786 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:08,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:08,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:08,786 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-11 04:55:08,786 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-11 04:55:08,786 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:08,786 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,787 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:08,789 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-11 04:55:08,789 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,789 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:08,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:08,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:08,789 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-11 04:55:08,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:08,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:08,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:08,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:08,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:08,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:08,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-11 04:55:08,792 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-11 04:55:08,792 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:08,792 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:08,792 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-11 04:55:08,792 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:08,793 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:08,793 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:08,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:08,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:08,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:08,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:08,793 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:08,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:08,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:08,794 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:08,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:08,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:08,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:08,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:08,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:08,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,795 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:08,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:08,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,797 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,797 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:08,797 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:08,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:08,797 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:08,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:08,797 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-11 04:55:08,797 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:08,797 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:08,797 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:08,797 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,797 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:08,797 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:08,798 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:08,798 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:08,798 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:08,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:08,898 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:08,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:08,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:08,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:08,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:08,903 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:08,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:08,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-11 04:55:08,904 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-11 04:55:08,905 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:08,905 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-11 04:55:08,905 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-11 04:55:08,905 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:08,905 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:08,906 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:08,906 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:08,907 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:08,907 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:08,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:08,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:08,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:08,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:08,908 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-11 04:55:08,908 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-11 04:55:08,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-11 04:55:08,908 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-11 04:55:08,908 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:08,908 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-11 04:55:08,908 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:08,908 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. started... 2023-11-11 04:55:08,908 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing edd1396e4f13db5121a27e2b760689b0 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 04:55:08,913 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:08,913 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:08,913 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:08,913 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. started... 2023-11-11 04:55:08,913 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:08,913 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. started... 2023-11-11 04:55:08,913 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2e6918dc58f4aaaece8729bb59a834ed 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 04:55:08,913 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 33b07a4e052e234a667f8fd20a21a8a8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 04:55:08,937 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111f5bb6de94a6e4ce487a84bc3e75606da to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111f5bb6de94a6e4ce487a84bc3e75606da 2023-11-11 04:55:08,945 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/f2d90811090543daa0c9af48ea406ae3 2023-11-11 04:55:08,971 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311115453b014bab84b1ebe7edfb5d0979f32 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311115453b014bab84b1ebe7edfb5d0979f32 2023-11-11 04:55:08,988 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/3d126496eb57424ea45e6ab8b0e9a796 2023-11-11 04:55:08,994 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/f2d90811090543daa0c9af48ea406ae3 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f2d90811090543daa0c9af48ea406ae3 2023-11-11 04:55:08,999 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f2d90811090543daa0c9af48ea406ae3, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 04:55:09,000 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/3d126496eb57424ea45e6ab8b0e9a796 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/3d126496eb57424ea45e6ab8b0e9a796 2023-11-11 04:55:09,004 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/3d126496eb57424ea45e6ab8b0e9a796, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 04:55:09,005 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2e6918dc58f4aaaece8729bb59a834ed in 92ms, sequenceid=13, compaction requested=true 2023-11-11 04:55:09,005 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:09,005 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:09,005 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:09,337 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111f5382da71c6c4ae0a4c849e97191fab9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111f5382da71c6c4ae0a4c849e97191fab9 2023-11-11 04:55:09,340 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111af4a7071765b489580d599a0f4825e31 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111af4a7071765b489580d599a0f4825e31 2023-11-11 04:55:09,342 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/7f9a11a16f5548698995bc9ef531ce9a 2023-11-11 04:55:09,348 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/f2e0c5b2c2324049be346d8ecaf99012 2023-11-11 04:55:09,362 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111d0a1bc1da050432a890c3b137c9d235c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111d0a1bc1da050432a890c3b137c9d235c 2023-11-11 04:55:09,761 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111191365018e72941e089a192c359010895 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111191365018e72941e089a192c359010895 2023-11-11 04:55:09,769 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/a389ca6175d748b3a8f28aa471b4f54d 2023-11-11 04:55:09,773 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/f2e0c5b2c2324049be346d8ecaf99012 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f2e0c5b2c2324049be346d8ecaf99012 2023-11-11 04:55:09,776 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f2e0c5b2c2324049be346d8ecaf99012, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 04:55:09,777 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/a389ca6175d748b3a8f28aa471b4f54d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/a389ca6175d748b3a8f28aa471b4f54d 2023-11-11 04:55:09,780 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/a389ca6175d748b3a8f28aa471b4f54d, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 04:55:09,780 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 33b07a4e052e234a667f8fd20a21a8a8 in 867ms, sequenceid=13, compaction requested=true 2023-11-11 04:55:09,781 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:09,781 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:09,781 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:10,166 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/71cef7d3bb9d45d0982a108ae89701b9 2023-11-11 04:55:10,170 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/7f9a11a16f5548698995bc9ef531ce9a as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/7f9a11a16f5548698995bc9ef531ce9a 2023-11-11 04:55:10,175 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/7f9a11a16f5548698995bc9ef531ce9a, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 04:55:10,175 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/71cef7d3bb9d45d0982a108ae89701b9 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/71cef7d3bb9d45d0982a108ae89701b9 2023-11-11 04:55:10,181 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/71cef7d3bb9d45d0982a108ae89701b9, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 04:55:10,182 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for edd1396e4f13db5121a27e2b760689b0 in 1274ms, sequenceid=13, compaction requested=true 2023-11-11 04:55:10,182 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:10,182 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:10,182 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:10,182 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:10,182 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,182 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-11 04:55:10,182 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-11 04:55:10,185 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:10,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-11 04:55:10,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11bde3e4[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:10,188 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-11 04:55:10,188 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:10,189 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:10,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:10,189 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,189 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-11 04:55:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-11 04:55:10,189 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:10,191 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-11 04:55:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:10,191 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-11 04:55:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:10,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:10,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-11 04:55:10,194 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-11 04:55:10,194 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:10,194 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:10,194 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-11 04:55:10,194 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:10,196 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:10,196 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:10,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:10,196 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:10,196 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:10,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:10,198 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:10,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,201 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,201 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:10,201 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:10,201 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:10,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:10,201 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-11 04:55:10,201 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:10,201 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:10,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-11 04:55:10,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:10,201 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:10,201 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,201 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:10,201 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:10,201 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:10,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:10,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:10,201 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:10,201 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:10,301 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:10,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:10,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:10,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:10,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:10,306 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:10,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:10,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-11 04:55:10,308 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-11 04:55:10,308 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:10,308 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-11 04:55:10,308 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-11 04:55:10,308 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:10,308 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:10,310 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,310 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:10,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:10,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:10,310 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:10,310 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:10,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:10,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:10,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:10,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:10,311 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-11 04:55:10,311 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-11 04:55:10,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-11 04:55:10,311 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-11 04:55:10,311 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:10,311 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-11 04:55:10,316 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:10,316 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:10,316 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:10,316 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:10,316 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:10,316 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. started... 2023-11-11 04:55:10,316 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. started... 2023-11-11 04:55:10,316 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. started... 2023-11-11 04:55:10,316 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 33b07a4e052e234a667f8fd20a21a8a8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 04:55:10,317 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2e6918dc58f4aaaece8729bb59a834ed 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 04:55:10,317 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing edd1396e4f13db5121a27e2b760689b0 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 04:55:10,341 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111628ad76e6077411eba70094fbdba3545 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111628ad76e6077411eba70094fbdba3545 2023-11-11 04:55:10,343 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111b619683a8f114e46a6961ac0addddaaf to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111b619683a8f114e46a6961ac0addddaaf 2023-11-11 04:55:10,363 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/f7f70e6cdeb34eb4af2e12d03877f7ef 2023-11-11 04:55:10,378 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311112de27631a5fd4a94a0b593381591b03d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311112de27631a5fd4a94a0b593381591b03d 2023-11-11 04:55:10,387 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/a9140b4dcf474b5fa4827e8e922d4240 2023-11-11 04:55:10,392 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/f7f70e6cdeb34eb4af2e12d03877f7ef as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f7f70e6cdeb34eb4af2e12d03877f7ef 2023-11-11 04:55:10,395 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f7f70e6cdeb34eb4af2e12d03877f7ef, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 04:55:10,396 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/a9140b4dcf474b5fa4827e8e922d4240 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a9140b4dcf474b5fa4827e8e922d4240 2023-11-11 04:55:10,400 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a9140b4dcf474b5fa4827e8e922d4240, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 04:55:10,401 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2e6918dc58f4aaaece8729bb59a834ed in 85ms, sequenceid=17, compaction requested=true 2023-11-11 04:55:10,401 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:10,401 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:10,401 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:10,737 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111178caad0ad1cf418293d96cc7fb3f5378 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111178caad0ad1cf418293d96cc7fb3f5378 2023-11-11 04:55:10,758 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/bf9d9322389446199459ec475a4182fb 2023-11-11 04:55:11,143 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/5ec341d2742c46378979d1289fa4b2f3 2023-11-11 04:55:11,178 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311111c5be427381b485181dc09be207217fb to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311111c5be427381b485181dc09be207217fb 2023-11-11 04:55:11,557 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111bf6b8223203a4ed0a38829b84e88bce4 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111bf6b8223203a4ed0a38829b84e88bce4 2023-11-11 04:55:11,583 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/bf5f9e8ac56540e981b58e11f0cfd06e 2023-11-11 04:55:11,586 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/bf9d9322389446199459ec475a4182fb as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/bf9d9322389446199459ec475a4182fb 2023-11-11 04:55:11,590 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/bf9d9322389446199459ec475a4182fb, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 04:55:11,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/bf5f9e8ac56540e981b58e11f0cfd06e as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/bf5f9e8ac56540e981b58e11f0cfd06e 2023-11-11 04:55:11,594 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/bf5f9e8ac56540e981b58e11f0cfd06e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 04:55:11,594 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 33b07a4e052e234a667f8fd20a21a8a8 in 1278ms, sequenceid=17, compaction requested=true 2023-11-11 04:55:11,594 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:11,594 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:11,594 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:11,962 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/4d7faf7097e046b88674840e9692e390 2023-11-11 04:55:11,973 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/5ec341d2742c46378979d1289fa4b2f3 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/5ec341d2742c46378979d1289fa4b2f3 2023-11-11 04:55:11,977 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/5ec341d2742c46378979d1289fa4b2f3, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 04:55:11,978 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/4d7faf7097e046b88674840e9692e390 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/4d7faf7097e046b88674840e9692e390 2023-11-11 04:55:11,982 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/4d7faf7097e046b88674840e9692e390, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 04:55:11,982 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for edd1396e4f13db5121a27e2b760689b0 in 1666ms, sequenceid=17, compaction requested=true 2023-11-11 04:55:11,983 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:11,983 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:11,983 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:11,983 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:11,983 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:11,983 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-11 04:55:11,983 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-11 04:55:11,985 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:11,985 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:11,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:11,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:11,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:11,985 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:11,985 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:11,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:11,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:11,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:11,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:11,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:11,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-11 04:55:11,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4957ac08[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:11,987 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-11 04:55:11,987 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:11,988 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:11,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:11,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:11,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-11 04:55:11,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-11 04:55:11,988 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:11,988 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:11,988 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:11,995 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:11,995 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-11 04:55:11,995 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:11,995 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-11 04:55:11,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:11,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:11,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:11,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:11,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:11,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:11,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-11 04:55:11,998 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-11 04:55:11,999 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:11,999 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:11,999 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-11 04:55:11,999 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:12,001 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:12,001 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:12,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:12,001 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:12,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:12,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:12,002 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:12,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:12,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:12,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:12,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,003 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:12,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:12,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:12,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:12,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:12,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:12,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:12,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,007 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:12,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:12,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:12,007 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-11 04:55:12,007 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:12,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:12,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:12,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:12,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:12,008 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:12,008 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:12,108 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:12,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:12,119 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 04:55:12,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699678512119 (current time:1699678512119). 2023-11-11 04:55:12,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-11 04:55:12,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] zookeeper.ReadOnlyZKClient(139): Connect 0x0e18aae4 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:55:12,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14c397e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:55:12,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:55:12,133 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:55:12,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e18aae4 to 127.0.0.1:61842 2023-11-11 04:55:12,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:12,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-11 04:55:12,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 04:55:12,143 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot, current working dir path: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/.tmp/snaptb-1699678512109 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-11 04:55:12,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 04:55:12,151 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 04:55:12,152 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699679112152 2023-11-11 04:55:12,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 04:55:12,152 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1699678512109 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-11 04:55:12,153 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 04:55:12,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-11 04:55:12,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-11-11 04:55:12,154 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-11 04:55:12,155 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1699679112155 2023-11-11 04:55:12,157 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:12,157 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-11 04:55:12,257 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 04:55:12,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 04:55:12,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 04:55:12,261 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-11 04:55:12,461 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 04:55:12,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 04:55:12,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 04:55:12,462 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-11 04:55:12,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1699678512109 2023-11-11 04:55:12,566 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1699678512109' 2023-11-11 04:55:12,566 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-11 04:55:12,566 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1699678512109' starting 'acquire' 2023-11-11 04:55:12,566 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1699678512109', kicking off acquire phase on members. 2023-11-11 04:55:12,566 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699678512109 2023-11-11 04:55:12,566 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1699678512109 2023-11-11 04:55:12,568 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1699678512109/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,568 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-11 04:55:12,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-11 04:55:12,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-11 04:55:12,568 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1699678512109/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,568 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:12,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1699678512109 2023-11-11 04:55:12,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699678512109 2023-11-11 04:55:12,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-11 04:55:12,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1699678512109 2023-11-11 04:55:12,569 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1699678512109 from table testCompactionWithHFileLink type FLUSH 2023-11-11 04:55:12,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1699678512109 2023-11-11 04:55:12,571 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1699678512109' with timeout 300000ms 2023-11-11 04:55:12,571 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-11 04:55:12,571 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1699678512109' starting 'acquire' stage 2023-11-11 04:55:12,571 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1699678512109' locally acquired 2023-11-11 04:55:12,571 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (snaptb-1699678512109) in zk 2023-11-11 04:55:12,572 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699678512109/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,572 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1699678512109 2023-11-11 04:55:12,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1699678512109/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:12,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-11 04:55:12,573 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699678512109 2023-11-11 04:55:12,573 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1699678512109' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:12,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:12,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:12,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699678512109 2023-11-11 04:55:12,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:12,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'snaptb-1699678512109' on coordinator 2023-11-11 04:55:12,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a650f0d[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:12,574 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1699678512109' starting 'in-barrier' execution. 2023-11-11 04:55:12,574 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1699678512109 2023-11-11 04:55:12,575 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699678512109 2023-11-11 04:55:12,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1699678512109 2023-11-11 04:55:12,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1699678512109 2023-11-11 04:55:12,575 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1699678512109' received 'reached' from coordinator. 2023-11-11 04:55:12,575 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699678512109/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:12,576 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:12,576 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:12,576 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-11 04:55:12,576 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:12,576 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-11 04:55:12,576 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:12,576 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. started... 2023-11-11 04:55:12,576 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. started... 2023-11-11 04:55:12,577 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. started... 2023-11-11 04:55:12,577 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:12,577 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:12,577 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:12,577 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.' region-info for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,577 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.' region-info for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,577 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.' region-info for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,582 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-11 04:55:12,582 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-11 04:55:12,582 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-11 04:55:12,586 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/16405ac9a365499f9f5faf021b56d1cf, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/28367240a6564659b26a1497ebdc745c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f2d90811090543daa0c9af48ea406ae3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f7f70e6cdeb34eb4af2e12d03877f7ef] hfiles 2023-11-11 04:55:12,586 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f56fd7a3395d43f0a8a4b805c83f468f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/56070528552f473f85235d97f88da6f9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f2e0c5b2c2324049be346d8ecaf99012, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/bf9d9322389446199459ec475a4182fb] hfiles 2023-11-11 04:55:12,586 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/130eb83344b043c39e617cf762c1384d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/d13db27086754f10abfc2f8b9784bba2, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/7f9a11a16f5548698995bc9ef531ce9a, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/5ec341d2742c46378979d1289fa4b2f3] hfiles 2023-11-11 04:55:12,586 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f56fd7a3395d43f0a8a4b805c83f468f for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,586 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/16405ac9a365499f9f5faf021b56d1cf for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,586 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/130eb83344b043c39e617cf762c1384d for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,589 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/28367240a6564659b26a1497ebdc745c for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,589 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/d13db27086754f10abfc2f8b9784bba2 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,589 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/56070528552f473f85235d97f88da6f9 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,589 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/7f9a11a16f5548698995bc9ef531ce9a for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,589 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f2d90811090543daa0c9af48ea406ae3 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/5ec341d2742c46378979d1289fa4b2f3 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f2e0c5b2c2324049be346d8ecaf99012 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f7f70e6cdeb34eb4af2e12d03877f7ef for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/b99159def6524322a8bb631204eb429f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/ad560bd65d1d41a9b263affab1c67608, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/71cef7d3bb9d45d0982a108ae89701b9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/4d7faf7097e046b88674840e9692e390] hfiles 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/19b17102fd1e4465825162c0692e474d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a2276e6d835a4fc9844f3864abb06013, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/3d126496eb57424ea45e6ab8b0e9a796, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a9140b4dcf474b5fa4827e8e922d4240] hfiles 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/19b17102fd1e4465825162c0692e474d for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/bf9d9322389446199459ec475a4182fb for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a2276e6d835a4fc9844f3864abb06013 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/0c94b698495645a380e12a9e6c768bea, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/64f9c35100864faf98ee944976b8d698, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/a389ca6175d748b3a8f28aa471b4f54d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/bf5f9e8ac56540e981b58e11f0cfd06e] hfiles 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/b99159def6524322a8bb631204eb429f for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/0c94b698495645a380e12a9e6c768bea for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/3d126496eb57424ea45e6ab8b0e9a796 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/64f9c35100864faf98ee944976b8d698 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/ad560bd65d1d41a9b263affab1c67608 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/a389ca6175d748b3a8f28aa471b4f54d for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a9140b4dcf474b5fa4827e8e922d4240 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/bf5f9e8ac56540e981b58e11f0cfd06e for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/71cef7d3bb9d45d0982a108ae89701b9 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/4d7faf7097e046b88674840e9692e390 for snapshot=snaptb-1699678512109 2023-11-11 04:55:12,605 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. completed. 2023-11-11 04:55:12,605 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:12,605 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-11 04:55:12,762 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 04:55:12,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 04:55:12,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 04:55:12,764 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-11 04:55:12,822 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-11 04:55:13,001 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. completed. 2023-11-11 04:55:13,001 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:13,001 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-11 04:55:13,006 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. completed. 2023-11-11 04:55:13,006 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:13,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-11 04:55:13,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-11 04:55:13,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:13,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1699678512109' locally completed 2023-11-11 04:55:13,006 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1699678512109' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:13,009 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699678512109/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:13,009 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1699678512109' has notified controller of completion 2023-11-11 04:55:13,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1699678512109/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:13,009 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:13,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:13,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-11 04:55:13,009 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1699678512109' completed. 2023-11-11 04:55:13,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:13,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:13,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699678512109 2023-11-11 04:55:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699678512109 2023-11-11 04:55:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1699678512109' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:13,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'snaptb-1699678512109', counting down latch. Waiting for 0 more 2023-11-11 04:55:13,012 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1699678512109' execution completed 2023-11-11 04:55:13,012 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:13,012 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:13,012 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1699678512109 2023-11-11 04:55:13,012 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1699678512109including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-11 04:55:13,014 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699678512109 2023-11-11 04:55:13,014 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699678512109 2023-11-11 04:55:13,014 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-11 04:55:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1699678512109 2023-11-11 04:55:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-11 04:55:13,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1699678512109 2023-11-11 04:55:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699678512109 2023-11-11 04:55:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:13,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-11 04:55:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-11 04:55:13,015 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1699678512109/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699678512109 2023-11-11 04:55:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699678512109 2023-11-11 04:55:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:13,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699678512109 2023-11-11 04:55:13,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:13,016 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1699678512109/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:13,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:13,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699678512109 2023-11-11 04:55:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:13,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699678512109/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:13,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699678512109 2023-11-11 04:55:13,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699678512109 2023-11-11 04:55:13,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699678512109/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:13,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-11 04:55:13,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699678512109 2023-11-11 04:55:13,018 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:13,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699678512109 2023-11-11 04:55:13,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-11 04:55:13,018 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1699678512109 2023-11-11 04:55:13,018 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-11 04:55:13,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-11 04:55:13,019 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699678512109 2023-11-11 04:55:13,019 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-11 04:55:13,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1699678512109 2023-11-11 04:55:13,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-11 04:55:13,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-11 04:55:13,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-11 04:55:13,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311114c27dcb5b95749b5b8fec200b71ee172, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111178caad0ad1cf418293d96cc7fb3f5378, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111e7d88fe71d9d44c4b10c40d15ee58632, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111f5382da71c6c4ae0a4c849e97191fab9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311110fdb441fa47c41deaca27867a85c5b93, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311114672dc24b4d444349fca18ab7ab4a928, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111b619683a8f114e46a6961ac0addddaaf, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111f5bb6de94a6e4ce487a84bc3e75606da, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111115b461efbf6c454d9c6d99ee8e1a99b8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111628ad76e6077411eba70094fbdba3545, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111af4a7071765b489580d599a0f4825e31, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111caed6a357ed943a28bdb4e86dc99a72c] mob files 2023-11-11 04:55:13,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311114c27dcb5b95749b5b8fec200b71ee172 2023-11-11 04:55:13,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111178caad0ad1cf418293d96cc7fb3f5378 2023-11-11 04:55:13,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111e7d88fe71d9d44c4b10c40d15ee58632 2023-11-11 04:55:13,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111f5382da71c6c4ae0a4c849e97191fab9 2023-11-11 04:55:13,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311110fdb441fa47c41deaca27867a85c5b93 2023-11-11 04:55:13,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311114672dc24b4d444349fca18ab7ab4a928 2023-11-11 04:55:13,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111b619683a8f114e46a6961ac0addddaaf 2023-11-11 04:55:13,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111f5bb6de94a6e4ce487a84bc3e75606da 2023-11-11 04:55:13,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111115b461efbf6c454d9c6d99ee8e1a99b8 2023-11-11 04:55:13,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111628ad76e6077411eba70094fbdba3545 2023-11-11 04:55:13,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111af4a7071765b489580d599a0f4825e31 2023-11-11 04:55:13,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111caed6a357ed943a28bdb4e86dc99a72c 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111573dc72285f14e2cbffb3118ac5db671, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111191365018e72941e089a192c359010895, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311119571cdd86be446f181b56f834cee3fb3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111bf6b8223203a4ed0a38829b84e88bce4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111289716d95b0e459788936174978b408b, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311112de27631a5fd4a94a0b593381591b03d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111391e5c23ef08445b95fb7b969e5915e6, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311115453b014bab84b1ebe7edfb5d0979f32, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311111c5be427381b485181dc09be207217fb, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311115019de6342cf4348a988f26801b02be9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111bced2b1f25574d1bb7bae52210739243, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111d0a1bc1da050432a890c3b137c9d235c] mob files 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111573dc72285f14e2cbffb3118ac5db671 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111191365018e72941e089a192c359010895 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311119571cdd86be446f181b56f834cee3fb3 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111bf6b8223203a4ed0a38829b84e88bce4 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111289716d95b0e459788936174978b408b 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311112de27631a5fd4a94a0b593381591b03d 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111391e5c23ef08445b95fb7b969e5915e6 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311115453b014bab84b1ebe7edfb5d0979f32 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311111c5be427381b485181dc09be207217fb 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311115019de6342cf4348a988f26801b02be9 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111bced2b1f25574d1bb7bae52210739243 2023-11-11 04:55:13,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111d0a1bc1da050432a890c3b137c9d235c 2023-11-11 04:55:13,264 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 04:55:13,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 04:55:13,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 04:55:13,265 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-11 04:55:13,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1699678512109 2023-11-11 04:55:13,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/.tmp/snaptb-1699678512109 2023-11-11 04:55:13,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/.tmp/snaptb-1699678512109 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/snaptb-1699678512109 2023-11-11 04:55:13,871 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1699678512109 of table testCompactionWithHFileLink completed 2023-11-11 04:55:13,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/.tmp/snaptb-1699678512109 2023-11-11 04:55:13,871 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/.tmp/snaptb-1699678512109 2023-11-11 04:55:13,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1699678512109 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699678512152Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1699678513427 (+1275 ms)Consolidate snapshot: snaptb-1699678512109 at 1699678513427Loading Region manifests for snaptb-1699678512109 at 1699678513428 (+1 ms)Writing data manifest for snaptb-1699678512109 at 1699678513436 (+8 ms)Verifying snapshot: snaptb-1699678512109 at 1699678513842 (+406 ms)Snapshot snaptb-1699678512109 of table testCompactionWithHFileLink completed at 1699678513871 (+29 ms) 2023-11-11 04:55:13,873 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-11 04:55:13,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7200 sec 2023-11-11 04:55:14,265 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 04:55:14,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 04:55:14,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-11 04:55:14,295 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:14,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:14,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-11 04:55:14,297 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-11 04:55:14,297 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:14,297 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-11 04:55:14,297 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-11 04:55:14,297 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:14,297 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:14,299 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:14,299 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:14,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:14,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:14,299 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:14,299 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:14,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:14,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:14,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:14,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:14,300 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-11 04:55:14,300 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-11 04:55:14,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-11 04:55:14,300 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-11 04:55:14,300 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:14,300 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-11 04:55:14,301 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:14,301 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. started... 2023-11-11 04:55:14,301 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:14,301 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. started... 2023-11-11 04:55:14,301 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing edd1396e4f13db5121a27e2b760689b0 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 04:55:14,301 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 33b07a4e052e234a667f8fd20a21a8a8 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 04:55:14,305 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:14,305 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:14,305 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:14,306 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. started... 2023-11-11 04:55:14,306 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2e6918dc58f4aaaece8729bb59a834ed 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 04:55:15,129 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/7fddd4821a084edda951342b2a46020d 2023-11-11 04:55:15,132 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/c66981be60b443edb90a55105b8894df 2023-11-11 04:55:15,132 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/264d7e8ab40046989522c0615e397983 2023-11-11 04:55:15,134 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fddd4821a084edda951342b2a46020d 2023-11-11 04:55:15,138 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c66981be60b443edb90a55105b8894df 2023-11-11 04:55:15,139 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 264d7e8ab40046989522c0615e397983 2023-11-11 04:55:15,167 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/65d9985497f94279ac46b2e1320da12d 2023-11-11 04:55:15,171 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65d9985497f94279ac46b2e1320da12d 2023-11-11 04:55:15,172 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/7fddd4821a084edda951342b2a46020d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/7fddd4821a084edda951342b2a46020d 2023-11-11 04:55:15,176 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fddd4821a084edda951342b2a46020d 2023-11-11 04:55:15,176 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/7fddd4821a084edda951342b2a46020d, entries=3, sequenceid=24, filesize=5.0 K 2023-11-11 04:55:15,177 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/65d9985497f94279ac46b2e1320da12d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/65d9985497f94279ac46b2e1320da12d 2023-11-11 04:55:15,180 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65d9985497f94279ac46b2e1320da12d 2023-11-11 04:55:15,180 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/65d9985497f94279ac46b2e1320da12d, entries=1, sequenceid=24, filesize=5.0 K 2023-11-11 04:55:15,181 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 33b07a4e052e234a667f8fd20a21a8a8 in 880ms, sequenceid=24, compaction requested=true 2023-11-11 04:55:15,181 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:15,181 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:15,182 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:15,570 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/0a23fd23e9e74079a21157428d1ba2e0 2023-11-11 04:55:15,574 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a23fd23e9e74079a21157428d1ba2e0 2023-11-11 04:55:15,575 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/c66981be60b443edb90a55105b8894df as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/c66981be60b443edb90a55105b8894df 2023-11-11 04:55:15,579 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c66981be60b443edb90a55105b8894df 2023-11-11 04:55:15,579 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/c66981be60b443edb90a55105b8894df, entries=3, sequenceid=24, filesize=5.0 K 2023-11-11 04:55:15,580 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/0a23fd23e9e74079a21157428d1ba2e0 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/0a23fd23e9e74079a21157428d1ba2e0 2023-11-11 04:55:15,584 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a23fd23e9e74079a21157428d1ba2e0 2023-11-11 04:55:15,584 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/0a23fd23e9e74079a21157428d1ba2e0, entries=1, sequenceid=24, filesize=5.0 K 2023-11-11 04:55:15,585 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for edd1396e4f13db5121a27e2b760689b0 in 1284ms, sequenceid=24, compaction requested=true 2023-11-11 04:55:15,585 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:15,585 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:15,585 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:15,972 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/076030b08ff24d13a0ae91309a67a232 2023-11-11 04:55:15,977 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 076030b08ff24d13a0ae91309a67a232 2023-11-11 04:55:15,978 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/264d7e8ab40046989522c0615e397983 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/264d7e8ab40046989522c0615e397983 2023-11-11 04:55:15,982 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 264d7e8ab40046989522c0615e397983 2023-11-11 04:55:15,982 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/264d7e8ab40046989522c0615e397983, entries=3, sequenceid=24, filesize=5.0 K 2023-11-11 04:55:15,983 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/076030b08ff24d13a0ae91309a67a232 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/076030b08ff24d13a0ae91309a67a232 2023-11-11 04:55:15,988 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 076030b08ff24d13a0ae91309a67a232 2023-11-11 04:55:15,988 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/076030b08ff24d13a0ae91309a67a232, entries=1, sequenceid=24, filesize=5.0 K 2023-11-11 04:55:15,989 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2e6918dc58f4aaaece8729bb59a834ed in 1683ms, sequenceid=24, compaction requested=true 2023-11-11 04:55:15,989 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:15,989 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:15,989 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:15,989 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:15,989 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:15,989 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-11 04:55:15,989 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-11 04:55:15,991 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:15,991 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:15,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:15,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:15,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:15,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:15,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:15,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:15,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:15,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:15,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-11 04:55:15,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5170b0d3[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:15,993 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-11 04:55:15,993 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:15,995 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:15,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:15,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:15,995 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-11 04:55:15,995 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-11 04:55:15,995 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:15,995 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:15,995 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:15,998 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:15,998 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-11 04:55:15,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:15,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:15,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:15,998 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:15,998 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-11 04:55:15,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:15,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:15,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:15,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:15,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:16,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:16,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:16,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:16,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-11 04:55:16,001 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-11 04:55:16,001 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:16,001 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:16,001 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-11 04:55:16,001 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:16,002 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:16,002 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:16,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:16,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:16,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:16,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:16,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:16,002 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:16,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:16,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:16,003 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:16,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:16,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:16,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:16,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:16,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:16,004 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:16,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:16,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:16,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 04:55:16,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:16,006 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:16,006 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:16,006 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:16,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:16,006 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:16,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-11 04:55:16,006 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:16,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:16,006 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-11 04:55:16,006 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:16,006 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 04:55:16,006 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:16,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:16,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 04:55:16,007 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 04:55:16,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:16,007 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:16,007 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:16,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:16,107 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:16,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:16,108 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:16,109 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): edd1396e4f13db5121a27e2b760689b0/family1 is initiating major compaction (all files) 2023-11-11 04:55:16,109 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:16,109 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:16,110 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of edd1396e4f13db5121a27e2b760689b0/family1 in testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:16,110 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/130eb83344b043c39e617cf762c1384d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/d13db27086754f10abfc2f8b9784bba2, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/7f9a11a16f5548698995bc9ef531ce9a, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/5ec341d2742c46378979d1289fa4b2f3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/c66981be60b443edb90a55105b8894df] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp, totalSize=26.7 K 2023-11-11 04:55:16,111 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 130eb83344b043c39e617cf762c1384d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505332 2023-11-11 04:55:16,111 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting d13db27086754f10abfc2f8b9784bba2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507115 2023-11-11 04:55:16,111 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 7f9a11a16f5548698995bc9ef531ce9a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:16,112 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 5ec341d2742c46378979d1289fa4b2f3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510303 2023-11-11 04:55:16,112 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting c66981be60b443edb90a55105b8894df, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 04:55:16,125 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): edd1396e4f13db5121a27e2b760689b0#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:16,535 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311115aaed7cc6ea84be6a5b4dda42e230627_del 2023-11-11 04:55:16,535 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311115aaed7cc6ea84be6a5b4dda42e230627_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311115aaed7cc6ea84be6a5b4dda42e230627_del 2023-11-11 04:55:17,351 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6829f8ed9faa4ffab54771582984e687 2023-11-11 04:55:17,352 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/6829f8ed9faa4ffab54771582984e687 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/6829f8ed9faa4ffab54771582984e687 2023-11-11 04:55:17,355 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6829f8ed9faa4ffab54771582984e687 2023-11-11 04:55:17,356 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in edd1396e4f13db5121a27e2b760689b0/family1 of edd1396e4f13db5121a27e2b760689b0 into 6829f8ed9faa4ffab54771582984e687(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:55:17,357 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:17,357 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:17,357 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): edd1396e4f13db5121a27e2b760689b0/family2 is initiating major compaction (all files) 2023-11-11 04:55:17,357 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:17,357 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:17,357 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of edd1396e4f13db5121a27e2b760689b0/family2 in testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:17,357 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/b99159def6524322a8bb631204eb429f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/ad560bd65d1d41a9b263affab1c67608, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/71cef7d3bb9d45d0982a108ae89701b9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/4d7faf7097e046b88674840e9692e390, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/0a23fd23e9e74079a21157428d1ba2e0] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp, totalSize=25.4 K 2023-11-11 04:55:17,358 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting b99159def6524322a8bb631204eb429f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505332 2023-11-11 04:55:17,358 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting ad560bd65d1d41a9b263affab1c67608, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507115 2023-11-11 04:55:17,358 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 71cef7d3bb9d45d0982a108ae89701b9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:17,359 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 4d7faf7097e046b88674840e9692e390, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510303 2023-11-11 04:55:17,359 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 0a23fd23e9e74079a21157428d1ba2e0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 04:55:17,372 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): edd1396e4f13db5121a27e2b760689b0#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:17,394 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111142ef47bd83454e1a9dda056334eaefa0_del 2023-11-11 04:55:17,394 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111142ef47bd83454e1a9dda056334eaefa0_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111142ef47bd83454e1a9dda056334eaefa0_del 2023-11-11 04:55:17,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/130eb83344b043c39e617cf762c1384d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/d13db27086754f10abfc2f8b9784bba2, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/7f9a11a16f5548698995bc9ef531ce9a, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/5ec341d2742c46378979d1289fa4b2f3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/c66981be60b443edb90a55105b8894df] to archive 2023-11-11 04:55:17,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:17,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/130eb83344b043c39e617cf762c1384d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/130eb83344b043c39e617cf762c1384d 2023-11-11 04:55:17,413 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/d13db27086754f10abfc2f8b9784bba2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/d13db27086754f10abfc2f8b9784bba2 2023-11-11 04:55:17,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/7f9a11a16f5548698995bc9ef531ce9a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/7f9a11a16f5548698995bc9ef531ce9a 2023-11-11 04:55:17,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/5ec341d2742c46378979d1289fa4b2f3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/5ec341d2742c46378979d1289fa4b2f3 2023-11-11 04:55:17,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/c66981be60b443edb90a55105b8894df to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/c66981be60b443edb90a55105b8894df 2023-11-11 04:55:17,829 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22f9abca2302455f94a330f772bb68fc 2023-11-11 04:55:17,830 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/22f9abca2302455f94a330f772bb68fc as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/22f9abca2302455f94a330f772bb68fc 2023-11-11 04:55:17,834 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22f9abca2302455f94a330f772bb68fc 2023-11-11 04:55:17,835 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in edd1396e4f13db5121a27e2b760689b0/family2 of edd1396e4f13db5121a27e2b760689b0 into 22f9abca2302455f94a330f772bb68fc(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:55:17,835 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:17,835 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:17,836 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 33b07a4e052e234a667f8fd20a21a8a8/family1 is initiating major compaction (all files) 2023-11-11 04:55:17,836 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:17,836 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:17,836 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 33b07a4e052e234a667f8fd20a21a8a8/family1 in testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:17,836 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f56fd7a3395d43f0a8a4b805c83f468f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/56070528552f473f85235d97f88da6f9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f2e0c5b2c2324049be346d8ecaf99012, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/bf9d9322389446199459ec475a4182fb, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/7fddd4821a084edda951342b2a46020d] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp, totalSize=26.7 K 2023-11-11 04:55:17,837 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting f56fd7a3395d43f0a8a4b805c83f468f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505330 2023-11-11 04:55:17,837 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 56070528552f473f85235d97f88da6f9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507115 2023-11-11 04:55:17,838 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting f2e0c5b2c2324049be346d8ecaf99012, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:17,838 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting bf9d9322389446199459ec475a4182fb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510303 2023-11-11 04:55:17,838 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 7fddd4821a084edda951342b2a46020d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 04:55:17,848 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 33b07a4e052e234a667f8fd20a21a8a8#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:17,899 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/b99159def6524322a8bb631204eb429f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/ad560bd65d1d41a9b263affab1c67608, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/71cef7d3bb9d45d0982a108ae89701b9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/4d7faf7097e046b88674840e9692e390, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/0a23fd23e9e74079a21157428d1ba2e0] to archive 2023-11-11 04:55:17,900 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:17,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/b99159def6524322a8bb631204eb429f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/b99159def6524322a8bb631204eb429f 2023-11-11 04:55:17,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/ad560bd65d1d41a9b263affab1c67608 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/ad560bd65d1d41a9b263affab1c67608 2023-11-11 04:55:17,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/71cef7d3bb9d45d0982a108ae89701b9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/71cef7d3bb9d45d0982a108ae89701b9 2023-11-11 04:55:17,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/4d7faf7097e046b88674840e9692e390 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/4d7faf7097e046b88674840e9692e390 2023-11-11 04:55:17,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/0a23fd23e9e74079a21157428d1ba2e0 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/0a23fd23e9e74079a21157428d1ba2e0 2023-11-11 04:55:18,260 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231111f55a12bcfe1746b8bcbdf0df994efbed_del 2023-11-11 04:55:18,260 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111f55a12bcfe1746b8bcbdf0df994efbed_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111f55a12bcfe1746b8bcbdf0df994efbed_del 2023-11-11 04:55:18,325 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:55:18,675 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60d5dfc785f747b4836766e67b75a6a3 2023-11-11 04:55:18,675 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/60d5dfc785f747b4836766e67b75a6a3 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/60d5dfc785f747b4836766e67b75a6a3 2023-11-11 04:55:18,679 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60d5dfc785f747b4836766e67b75a6a3 2023-11-11 04:55:18,680 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 33b07a4e052e234a667f8fd20a21a8a8/family1 of 33b07a4e052e234a667f8fd20a21a8a8 into 60d5dfc785f747b4836766e67b75a6a3(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:55:18,680 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:18,680 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:18,680 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 33b07a4e052e234a667f8fd20a21a8a8/family2 is initiating major compaction (all files) 2023-11-11 04:55:18,680 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:18,680 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:18,680 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 33b07a4e052e234a667f8fd20a21a8a8/family2 in testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:18,681 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/0c94b698495645a380e12a9e6c768bea, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/64f9c35100864faf98ee944976b8d698, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/a389ca6175d748b3a8f28aa471b4f54d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/bf5f9e8ac56540e981b58e11f0cfd06e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/65d9985497f94279ac46b2e1320da12d] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp, totalSize=25.4 K 2023-11-11 04:55:18,681 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 0c94b698495645a380e12a9e6c768bea, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505330 2023-11-11 04:55:18,681 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 64f9c35100864faf98ee944976b8d698, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507115 2023-11-11 04:55:18,681 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting a389ca6175d748b3a8f28aa471b4f54d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:18,682 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting bf5f9e8ac56540e981b58e11f0cfd06e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510303 2023-11-11 04:55:18,682 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 65d9985497f94279ac46b2e1320da12d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 04:55:18,693 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 33b07a4e052e234a667f8fd20a21a8a8#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:18,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f56fd7a3395d43f0a8a4b805c83f468f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/56070528552f473f85235d97f88da6f9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f2e0c5b2c2324049be346d8ecaf99012, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/bf9d9322389446199459ec475a4182fb, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/7fddd4821a084edda951342b2a46020d] to archive 2023-11-11 04:55:18,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:18,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f56fd7a3395d43f0a8a4b805c83f468f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f56fd7a3395d43f0a8a4b805c83f468f 2023-11-11 04:55:18,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/56070528552f473f85235d97f88da6f9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/56070528552f473f85235d97f88da6f9 2023-11-11 04:55:18,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f2e0c5b2c2324049be346d8ecaf99012 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/f2e0c5b2c2324049be346d8ecaf99012 2023-11-11 04:55:18,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/bf9d9322389446199459ec475a4182fb to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/bf9d9322389446199459ec475a4182fb 2023-11-11 04:55:18,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/7fddd4821a084edda951342b2a46020d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/7fddd4821a084edda951342b2a46020d 2023-11-11 04:55:19,101 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231111cb0ca494adb4452cb66e4964c6b84aa9_del 2023-11-11 04:55:19,101 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111cb0ca494adb4452cb66e4964c6b84aa9_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111cb0ca494adb4452cb66e4964c6b84aa9_del 2023-11-11 04:55:19,114 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7bdcac848d046ec92ac01cd534c5056 2023-11-11 04:55:19,115 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/e7bdcac848d046ec92ac01cd534c5056 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/e7bdcac848d046ec92ac01cd534c5056 2023-11-11 04:55:19,119 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7bdcac848d046ec92ac01cd534c5056 2023-11-11 04:55:19,120 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 33b07a4e052e234a667f8fd20a21a8a8/family2 of 33b07a4e052e234a667f8fd20a21a8a8 into e7bdcac848d046ec92ac01cd534c5056(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:55:19,120 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:19,120 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:19,120 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 2e6918dc58f4aaaece8729bb59a834ed/family1 is initiating major compaction (all files) 2023-11-11 04:55:19,120 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:19,120 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:19,120 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 2e6918dc58f4aaaece8729bb59a834ed/family1 in testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:19,120 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/16405ac9a365499f9f5faf021b56d1cf, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/28367240a6564659b26a1497ebdc745c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f2d90811090543daa0c9af48ea406ae3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f7f70e6cdeb34eb4af2e12d03877f7ef, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/264d7e8ab40046989522c0615e397983] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp, totalSize=26.7 K 2023-11-11 04:55:19,121 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 16405ac9a365499f9f5faf021b56d1cf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505332 2023-11-11 04:55:19,121 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 28367240a6564659b26a1497ebdc745c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507116 2023-11-11 04:55:19,121 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting f2d90811090543daa0c9af48ea406ae3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:19,122 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting f7f70e6cdeb34eb4af2e12d03877f7ef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510304 2023-11-11 04:55:19,122 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 264d7e8ab40046989522c0615e397983, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 04:55:19,134 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 2e6918dc58f4aaaece8729bb59a834ed#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:19,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/0c94b698495645a380e12a9e6c768bea, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/64f9c35100864faf98ee944976b8d698, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/a389ca6175d748b3a8f28aa471b4f54d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/bf5f9e8ac56540e981b58e11f0cfd06e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/65d9985497f94279ac46b2e1320da12d] to archive 2023-11-11 04:55:19,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:19,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/0c94b698495645a380e12a9e6c768bea to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/0c94b698495645a380e12a9e6c768bea 2023-11-11 04:55:19,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/64f9c35100864faf98ee944976b8d698 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/64f9c35100864faf98ee944976b8d698 2023-11-11 04:55:19,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/a389ca6175d748b3a8f28aa471b4f54d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/a389ca6175d748b3a8f28aa471b4f54d 2023-11-11 04:55:19,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/bf5f9e8ac56540e981b58e11f0cfd06e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/bf5f9e8ac56540e981b58e11f0cfd06e 2023-11-11 04:55:19,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/65d9985497f94279ac46b2e1320da12d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/65d9985497f94279ac46b2e1320da12d 2023-11-11 04:55:19,544 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111068e06ee78534f0b9473a816147aa374_del 2023-11-11 04:55:19,544 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111068e06ee78534f0b9473a816147aa374_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111068e06ee78534f0b9473a816147aa374_del 2023-11-11 04:55:20,357 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 638cdd24eb8c4fcf92a3b4e166875394 2023-11-11 04:55:20,358 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/638cdd24eb8c4fcf92a3b4e166875394 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/638cdd24eb8c4fcf92a3b4e166875394 2023-11-11 04:55:20,362 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 638cdd24eb8c4fcf92a3b4e166875394 2023-11-11 04:55:20,363 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2e6918dc58f4aaaece8729bb59a834ed/family1 of 2e6918dc58f4aaaece8729bb59a834ed into 638cdd24eb8c4fcf92a3b4e166875394(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:55:20,363 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:20,363 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:20,363 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 2e6918dc58f4aaaece8729bb59a834ed/family2 is initiating major compaction (all files) 2023-11-11 04:55:20,363 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:20,363 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:20,364 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 2e6918dc58f4aaaece8729bb59a834ed/family2 in testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:20,364 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/19b17102fd1e4465825162c0692e474d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a2276e6d835a4fc9844f3864abb06013, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/3d126496eb57424ea45e6ab8b0e9a796, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a9140b4dcf474b5fa4827e8e922d4240, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/076030b08ff24d13a0ae91309a67a232] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp, totalSize=25.4 K 2023-11-11 04:55:20,364 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 19b17102fd1e4465825162c0692e474d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505332 2023-11-11 04:55:20,364 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting a2276e6d835a4fc9844f3864abb06013, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507116 2023-11-11 04:55:20,365 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 3d126496eb57424ea45e6ab8b0e9a796, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:20,365 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting a9140b4dcf474b5fa4827e8e922d4240, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510304 2023-11-11 04:55:20,365 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 076030b08ff24d13a0ae91309a67a232, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 04:55:20,381 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 2e6918dc58f4aaaece8729bb59a834ed#family2#compaction#113 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:20,389 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111ea2a840587f648e29af524b143a3f60e_del 2023-11-11 04:55:20,389 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111ea2a840587f648e29af524b143a3f60e_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111ea2a840587f648e29af524b143a3f60e_del 2023-11-11 04:55:20,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/16405ac9a365499f9f5faf021b56d1cf, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/28367240a6564659b26a1497ebdc745c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f2d90811090543daa0c9af48ea406ae3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f7f70e6cdeb34eb4af2e12d03877f7ef, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/264d7e8ab40046989522c0615e397983] to archive 2023-11-11 04:55:20,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:20,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/16405ac9a365499f9f5faf021b56d1cf to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/16405ac9a365499f9f5faf021b56d1cf 2023-11-11 04:55:20,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/28367240a6564659b26a1497ebdc745c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/28367240a6564659b26a1497ebdc745c 2023-11-11 04:55:20,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f2d90811090543daa0c9af48ea406ae3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f2d90811090543daa0c9af48ea406ae3 2023-11-11 04:55:20,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f7f70e6cdeb34eb4af2e12d03877f7ef to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/f7f70e6cdeb34eb4af2e12d03877f7ef 2023-11-11 04:55:20,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/264d7e8ab40046989522c0615e397983 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/264d7e8ab40046989522c0615e397983 2023-11-11 04:55:20,808 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 903454b8a2ba475a9b2127878138866a 2023-11-11 04:55:20,809 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/903454b8a2ba475a9b2127878138866a as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/903454b8a2ba475a9b2127878138866a 2023-11-11 04:55:20,813 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 903454b8a2ba475a9b2127878138866a 2023-11-11 04:55:20,814 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2e6918dc58f4aaaece8729bb59a834ed/family2 of 2e6918dc58f4aaaece8729bb59a834ed into 903454b8a2ba475a9b2127878138866a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:55:20,814 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:20,820 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:20,824 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:20,828 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:20,829 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:20,836 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 04:55:20,871 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-11 04:55:20,874 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231111f55a12bcfe1746b8bcbdf0df994efbed_del 2023-11-11 04:55:20,877 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311115aaed7cc6ea84be6a5b4dda42e230627_del 2023-11-11 04:55:20,880 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111068e06ee78534f0b9473a816147aa374_del 2023-11-11 04:55:20,881 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:20,881 DEBUG [Listener at localhost/35271] zookeeper.ReadOnlyZKClient(139): Connect 0x7e834060 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:55:20,886 DEBUG [Listener at localhost/35271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8153e9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:55:20,887 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:20,887 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:20,887 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:20,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/19b17102fd1e4465825162c0692e474d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a2276e6d835a4fc9844f3864abb06013, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/3d126496eb57424ea45e6ab8b0e9a796, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a9140b4dcf474b5fa4827e8e922d4240, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/076030b08ff24d13a0ae91309a67a232] to archive 2023-11-11 04:55:20,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:20,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/19b17102fd1e4465825162c0692e474d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/19b17102fd1e4465825162c0692e474d 2023-11-11 04:55:20,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a2276e6d835a4fc9844f3864abb06013 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a2276e6d835a4fc9844f3864abb06013 2023-11-11 04:55:20,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/3d126496eb57424ea45e6ab8b0e9a796 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/3d126496eb57424ea45e6ab8b0e9a796 2023-11-11 04:55:20,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a9140b4dcf474b5fa4827e8e922d4240 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/a9140b4dcf474b5fa4827e8e922d4240 2023-11-11 04:55:20,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/076030b08ff24d13a0ae91309a67a232 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/076030b08ff24d13a0ae91309a67a232 2023-11-11 04:55:21,775 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311112d15f8a210cd40acbeea2eabe5f9b38d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311112d15f8a210cd40acbeea2eabe5f9b38d 2023-11-11 04:55:21,776 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111165dffe722f9144deb969f749c99d3c99 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111165dffe722f9144deb969f749c99d3c99 2023-11-11 04:55:21,776 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:21,776 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:21,781 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111aad4e5c4f3b3466cbebe7ec339656396 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111aad4e5c4f3b3466cbebe7ec339656396 2023-11-11 04:55:21,782 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:21,790 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:55:21,794 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:55:21,799 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:55:21,801 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:55:21,822 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/a196e234966145cb9db69e820cf42d6a first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-11 04:55:21,823 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/a196e234966145cb9db69e820cf42d6a}] 2023-11-11 04:55:21,823 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/7846115aa530445396008e6d19303de3 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-11 04:55:21,823 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/b421e3111a814c639bc6b11deaffb909 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-11 04:55:21,825 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/7846115aa530445396008e6d19303de3}] 2023-11-11 04:55:21,825 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/b421e3111a814c639bc6b11deaffb909}] 2023-11-11 04:55:21,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/b421e3111a814c639bc6b11deaffb909 for inclusion in 2e6918dc58f4aaaece8729bb59a834ed/family1 2023-11-11 04:55:21,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/a196e234966145cb9db69e820cf42d6a for inclusion in edd1396e4f13db5121a27e2b760689b0/family1 2023-11-11 04:55:21,830 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/7846115aa530445396008e6d19303de3 for inclusion in 33b07a4e052e234a667f8fd20a21a8a8/family1 2023-11-11 04:55:21,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-11 04:55:21,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-11 04:55:21,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last=1 2023-11-11 04:55:21,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-11 04:55:21,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-11 04:55:21,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:21,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43941] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-11 04:55:21,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:21,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:21,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/b421e3111a814c639bc6b11deaffb909 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__leugeuahrlug9ccst3qh5jd4qeiv3fs9ij77tfdcu0db521nufsjgsfgd7ebtl1b/family1/b421e3111a814c639bc6b11deaffb909 2023-11-11 04:55:21,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/a196e234966145cb9db69e820cf42d6a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__99v2kkn07tstou8thtii358re13gju2nuppo41ke7t0jqgobsqfuaophirjcp2f2/family1/a196e234966145cb9db69e820cf42d6a 2023-11-11 04:55:21,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/7846115aa530445396008e6d19303de3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__u6gctqoof0n6qpmctv2np0gu1hc7tr8v40nfog5660ktokvkf8v3325pus3v4801/family1/7846115aa530445396008e6d19303de3 2023-11-11 04:55:21,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__leugeuahrlug9ccst3qh5jd4qeiv3fs9ij77tfdcu0db521nufsjgsfgd7ebtl1b/family1/b421e3111a814c639bc6b11deaffb909 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/277a8f5b22654b91b35aded69d6d045c_SeqId_29_ 2023-11-11 04:55:21,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__99v2kkn07tstou8thtii358re13gju2nuppo41ke7t0jqgobsqfuaophirjcp2f2/family1/a196e234966145cb9db69e820cf42d6a as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/175ada04d0254702a5110ea4503c4477_SeqId_29_ 2023-11-11 04:55:21,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__u6gctqoof0n6qpmctv2np0gu1hc7tr8v40nfog5660ktokvkf8v3325pus3v4801/family1/7846115aa530445396008e6d19303de3 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/604d06f1c88c43aa9d94174d62456103_SeqId_29_ 2023-11-11 04:55:21,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__leugeuahrlug9ccst3qh5jd4qeiv3fs9ij77tfdcu0db521nufsjgsfgd7ebtl1b/family1/b421e3111a814c639bc6b11deaffb909 into 2e6918dc58f4aaaece8729bb59a834ed/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/277a8f5b22654b91b35aded69d6d045c_SeqId_29_ - updating store file list. 2023-11-11 04:55:21,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__99v2kkn07tstou8thtii358re13gju2nuppo41ke7t0jqgobsqfuaophirjcp2f2/family1/a196e234966145cb9db69e820cf42d6a into edd1396e4f13db5121a27e2b760689b0/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/175ada04d0254702a5110ea4503c4477_SeqId_29_ - updating store file list. 2023-11-11 04:55:21,836 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__u6gctqoof0n6qpmctv2np0gu1hc7tr8v40nfog5660ktokvkf8v3325pus3v4801/family1/7846115aa530445396008e6d19303de3 into 33b07a4e052e234a667f8fd20a21a8a8/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/604d06f1c88c43aa9d94174d62456103_SeqId_29_ - updating store file list. 2023-11-11 04:55:21,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/277a8f5b22654b91b35aded69d6d045c_SeqId_29_ into 2e6918dc58f4aaaece8729bb59a834ed/family1 2023-11-11 04:55:21,842 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/175ada04d0254702a5110ea4503c4477_SeqId_29_ into edd1396e4f13db5121a27e2b760689b0/family1 2023-11-11 04:55:21,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__leugeuahrlug9ccst3qh5jd4qeiv3fs9ij77tfdcu0db521nufsjgsfgd7ebtl1b/family1/b421e3111a814c639bc6b11deaffb909 into 2e6918dc58f4aaaece8729bb59a834ed/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/277a8f5b22654b91b35aded69d6d045c_SeqId_29_) 2023-11-11 04:55:21,842 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__99v2kkn07tstou8thtii358re13gju2nuppo41ke7t0jqgobsqfuaophirjcp2f2/family1/a196e234966145cb9db69e820cf42d6a into edd1396e4f13db5121a27e2b760689b0/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/175ada04d0254702a5110ea4503c4477_SeqId_29_) 2023-11-11 04:55:21,842 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/604d06f1c88c43aa9d94174d62456103_SeqId_29_ into 33b07a4e052e234a667f8fd20a21a8a8/family1 2023-11-11 04:55:21,842 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__u6gctqoof0n6qpmctv2np0gu1hc7tr8v40nfog5660ktokvkf8v3325pus3v4801/family1/7846115aa530445396008e6d19303de3 into 33b07a4e052e234a667f8fd20a21a8a8/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/604d06f1c88c43aa9d94174d62456103_SeqId_29_) 2023-11-11 04:55:21,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__leugeuahrlug9ccst3qh5jd4qeiv3fs9ij77tfdcu0db521nufsjgsfgd7ebtl1b/family1/b421e3111a814c639bc6b11deaffb909 2023-11-11 04:55:21,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__u6gctqoof0n6qpmctv2np0gu1hc7tr8v40nfog5660ktokvkf8v3325pus3v4801/family1/7846115aa530445396008e6d19303de3 2023-11-11 04:55:21,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__99v2kkn07tstou8thtii358re13gju2nuppo41ke7t0jqgobsqfuaophirjcp2f2/family1/a196e234966145cb9db69e820cf42d6a 2023-11-11 04:55:21,845 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:21,845 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:21,845 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:21,845 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:21,845 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:21,846 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:21,847 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311110fdb441fa47c41deaca27867a85c5b93 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311110fdb441fa47c41deaca27867a85c5b93 2023-11-11 04:55:21,847 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311114c27dcb5b95749b5b8fec200b71ee172 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311114c27dcb5b95749b5b8fec200b71ee172 2023-11-11 04:55:21,847 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111115b461efbf6c454d9c6d99ee8e1a99b8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111115b461efbf6c454d9c6d99ee8e1a99b8 2023-11-11 04:55:21,848 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311114672dc24b4d444349fca18ab7ab4a928 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311114672dc24b4d444349fca18ab7ab4a928 2023-11-11 04:55:21,848 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111178caad0ad1cf418293d96cc7fb3f5378 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111178caad0ad1cf418293d96cc7fb3f5378 2023-11-11 04:55:21,849 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111628ad76e6077411eba70094fbdba3545 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111628ad76e6077411eba70094fbdba3545 2023-11-11 04:55:21,849 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111b619683a8f114e46a6961ac0addddaaf to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111b619683a8f114e46a6961ac0addddaaf 2023-11-11 04:55:21,849 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111e7d88fe71d9d44c4b10c40d15ee58632 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111e7d88fe71d9d44c4b10c40d15ee58632 2023-11-11 04:55:21,850 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111af4a7071765b489580d599a0f4825e31 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111af4a7071765b489580d599a0f4825e31 2023-11-11 04:55:21,850 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111f5bb6de94a6e4ce487a84bc3e75606da to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111f5bb6de94a6e4ce487a84bc3e75606da 2023-11-11 04:55:21,850 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111f5382da71c6c4ae0a4c849e97191fab9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111f5382da71c6c4ae0a4c849e97191fab9 2023-11-11 04:55:21,851 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 04:55:21,850 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 04:55:21,851 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111' 2023-11-11 04:55:21,851 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111' 2023-11-11 04:55:21,851 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:21,851 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:21,851 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111caed6a357ed943a28bdb4e86dc99a72c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111caed6a357ed943a28bdb4e86dc99a72c 2023-11-11 04:55:21,851 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 04:55:21,851 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111' 2023-11-11 04:55:21,852 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:21,852 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:21,852 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:21,852 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111f55a12bcfe1746b8bcbdf0df994efbed_del] 2023-11-11 04:55:21,852 DEBUG [Listener at localhost/35271] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:21,853 DEBUG [Listener at localhost/35271] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111f55a12bcfe1746b8bcbdf0df994efbed_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111f55a12bcfe1746b8bcbdf0df994efbed_del 2023-11-11 04:55:21,853 INFO [Listener at localhost/35271] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-11 04:55:21,853 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311115aaed7cc6ea84be6a5b4dda42e230627_del] 2023-11-11 04:55:21,854 DEBUG [Listener at localhost/35271] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:21,855 DEBUG [Listener at localhost/35271] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311115aaed7cc6ea84be6a5b4dda42e230627_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311115aaed7cc6ea84be6a5b4dda42e230627_del 2023-11-11 04:55:21,855 INFO [Listener at localhost/35271] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-11 04:55:21,855 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111068e06ee78534f0b9473a816147aa374_del] 2023-11-11 04:55:21,855 DEBUG [Listener at localhost/35271] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:21,856 DEBUG [Listener at localhost/35271] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111068e06ee78534f0b9473a816147aa374_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111068e06ee78534f0b9473a816147aa374_del 2023-11-11 04:55:21,856 INFO [Listener at localhost/35271] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-11 04:55:21,859 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:21,862 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:21,865 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:21,866 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:21,872 INFO [Listener at localhost/35271] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-11 04:55:21,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-11 04:55:21,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-11 04:55:21,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-11 04:55:21,875 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678521875"}]},"ts":"1699678521875"} 2023-11-11 04:55:21,876 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-11 04:55:21,879 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-11 04:55:21,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=33b07a4e052e234a667f8fd20a21a8a8, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=edd1396e4f13db5121a27e2b760689b0, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2e6918dc58f4aaaece8729bb59a834ed, UNASSIGN}] 2023-11-11 04:55:21,881 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=edd1396e4f13db5121a27e2b760689b0, UNASSIGN 2023-11-11 04:55:21,881 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=33b07a4e052e234a667f8fd20a21a8a8, UNASSIGN 2023-11-11 04:55:21,881 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2e6918dc58f4aaaece8729bb59a834ed, UNASSIGN 2023-11-11 04:55:21,882 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=edd1396e4f13db5121a27e2b760689b0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:21,882 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678521882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678521882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678521882"}]},"ts":"1699678521882"} 2023-11-11 04:55:21,882 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=33b07a4e052e234a667f8fd20a21a8a8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:21,882 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2e6918dc58f4aaaece8729bb59a834ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:21,882 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678521882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678521882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678521882"}]},"ts":"1699678521882"} 2023-11-11 04:55:21,882 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678521882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678521882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678521882"}]},"ts":"1699678521882"} 2023-11-11 04:55:21,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure edd1396e4f13db5121a27e2b760689b0, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:21,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 33b07a4e052e234a667f8fd20a21a8a8, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:21,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 2e6918dc58f4aaaece8729bb59a834ed, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:21,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-11 04:55:22,035 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:22,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:22,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing edd1396e4f13db5121a27e2b760689b0, disabling compactions & flushes 2023-11-11 04:55:22,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:22,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:22,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. after waiting 0 ms 2023-11-11 04:55:22,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:22,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-11 04:55:22,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:22,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:22,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:22,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:22,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 33b07a4e052e234a667f8fd20a21a8a8, disabling compactions & flushes 2023-11-11 04:55:22,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:22,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:22,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. after waiting 0 ms 2023-11-11 04:55:22,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:22,043 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=edd1396e4f13db5121a27e2b760689b0, regionState=CLOSED 2023-11-11 04:55:22,043 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678522043"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678522043"}]},"ts":"1699678522043"} 2023-11-11 04:55:22,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-11-11 04:55:22,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure edd1396e4f13db5121a27e2b760689b0, server=jenkins-hbase4.apache.org,43941,1699678403879 in 161 msec 2023-11-11 04:55:22,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-11 04:55:22,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=edd1396e4f13db5121a27e2b760689b0, UNASSIGN in 166 msec 2023-11-11 04:55:22,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:22,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:22,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:22,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:22,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2e6918dc58f4aaaece8729bb59a834ed, disabling compactions & flushes 2023-11-11 04:55:22,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:22,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:22,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. after waiting 0 ms 2023-11-11 04:55:22,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:22,049 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=33b07a4e052e234a667f8fd20a21a8a8, regionState=CLOSED 2023-11-11 04:55:22,049 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678522049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678522049"}]},"ts":"1699678522049"} 2023-11-11 04:55:22,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=89 2023-11-11 04:55:22,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 33b07a4e052e234a667f8fd20a21a8a8, server=jenkins-hbase4.apache.org,43941,1699678403879 in 166 msec 2023-11-11 04:55:22,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-11 04:55:22,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=33b07a4e052e234a667f8fd20a21a8a8, UNASSIGN in 172 msec 2023-11-11 04:55:22,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:22,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:22,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:22,054 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2e6918dc58f4aaaece8729bb59a834ed, regionState=CLOSED 2023-11-11 04:55:22,055 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678522054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678522054"}]},"ts":"1699678522054"} 2023-11-11 04:55:22,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-11-11 04:55:22,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 2e6918dc58f4aaaece8729bb59a834ed, server=jenkins-hbase4.apache.org,43941,1699678403879 in 172 msec 2023-11-11 04:55:22,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=88 2023-11-11 04:55:22,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2e6918dc58f4aaaece8729bb59a834ed, UNASSIGN in 177 msec 2023-11-11 04:55:22,058 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678522058"}]},"ts":"1699678522058"} 2023-11-11 04:55:22,059 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-11 04:55:22,061 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-11 04:55:22,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 189 msec 2023-11-11 04:55:22,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-11 04:55:22,177 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-11 04:55:22,187 INFO [Listener at localhost/35271] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1699678512109-1699678522187 2023-11-11 04:55:22,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 04:55:22,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699678522188 (current time:1699678522188). 2023-11-11 04:55:22,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-11 04:55:22,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] zookeeper.ReadOnlyZKClient(139): Connect 0x0cc17b09 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:55:22,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b7fcdc2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:55:22,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:55:22,196 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:55:22,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cc17b09 to 127.0.0.1:61842 2023-11-11 04:55:22,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:22,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-11 04:55:22,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 04:55:22,200 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot, current working dir path: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699678512109-1699678522187 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-11 04:55:22,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 04:55:22,202 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 04:55:22,202 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699679122202 2023-11-11 04:55:22,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 04:55:22,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1699678512109-1699678522187 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-11 04:55:22,203 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:22,203 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-11 04:55:22,303 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 04:55:22,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 04:55:22,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 04:55:22,304 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-11 04:55:22,504 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 04:55:22,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 04:55:22,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 04:55:22,506 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-11 04:55:22,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-11 04:55:22,611 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-11 04:55:22,611 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-11 04:55:22,611 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-11 04:55:22,611 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-11 04:55:22,611 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-11 04:55:22,611 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-11 04:55:22,611 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-11 04:55:22,612 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/604d06f1c88c43aa9d94174d62456103_SeqId_29_, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/60d5dfc785f747b4836766e67b75a6a3] hfiles 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/277a8f5b22654b91b35aded69d6d045c_SeqId_29_, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/638cdd24eb8c4fcf92a3b4e166875394] hfiles 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111aad4e5c4f3b3466cbebe7ec339656396, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111165dffe722f9144deb969f749c99d3c99, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311112d15f8a210cd40acbeea2eabe5f9b38d] hfiles 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/277a8f5b22654b91b35aded69d6d045c_SeqId_29_ 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/175ada04d0254702a5110ea4503c4477_SeqId_29_, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/6829f8ed9faa4ffab54771582984e687] hfiles 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/604d06f1c88c43aa9d94174d62456103_SeqId_29_ 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/175ada04d0254702a5110ea4503c4477_SeqId_29_ 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/638cdd24eb8c4fcf92a3b4e166875394 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/6829f8ed9faa4ffab54771582984e687 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111aad4e5c4f3b3466cbebe7ec339656396 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/60d5dfc785f747b4836766e67b75a6a3 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111165dffe722f9144deb969f749c99d3c99 2023-11-11 04:55:22,615 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311112d15f8a210cd40acbeea2eabe5f9b38d 2023-11-11 04:55:22,616 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/903454b8a2ba475a9b2127878138866a] hfiles 2023-11-11 04:55:22,616 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/903454b8a2ba475a9b2127878138866a 2023-11-11 04:55:22,616 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/22f9abca2302455f94a330f772bb68fc] hfiles 2023-11-11 04:55:22,616 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/22f9abca2302455f94a330f772bb68fc 2023-11-11 04:55:22,616 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/e7bdcac848d046ec92ac01cd534c5056] hfiles 2023-11-11 04:55:22,616 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/e7bdcac848d046ec92ac01cd534c5056 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111142ef47bd83454e1a9dda056334eaefa0_del, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111573dc72285f14e2cbffb3118ac5db671, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111191365018e72941e089a192c359010895, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311119571cdd86be446f181b56f834cee3fb3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111bf6b8223203a4ed0a38829b84e88bce4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111289716d95b0e459788936174978b408b, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311112de27631a5fd4a94a0b593381591b03d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111391e5c23ef08445b95fb7b969e5915e6, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311115453b014bab84b1ebe7edfb5d0979f32, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111ea2a840587f648e29af524b143a3f60e_del, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311111c5be427381b485181dc09be207217fb, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311115019de6342cf4348a988f26801b02be9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111bced2b1f25574d1bb7bae52210739243, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111cb0ca494adb4452cb66e4964c6b84aa9_del, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111d0a1bc1da050432a890c3b137c9d235c] hfiles 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111142ef47bd83454e1a9dda056334eaefa0_del 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111573dc72285f14e2cbffb3118ac5db671 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111191365018e72941e089a192c359010895 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311119571cdd86be446f181b56f834cee3fb3 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111bf6b8223203a4ed0a38829b84e88bce4 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111289716d95b0e459788936174978b408b 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311112de27631a5fd4a94a0b593381591b03d 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111391e5c23ef08445b95fb7b969e5915e6 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311115453b014bab84b1ebe7edfb5d0979f32 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111ea2a840587f648e29af524b143a3f60e_del 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311111c5be427381b485181dc09be207217fb 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311115019de6342cf4348a988f26801b02be9 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111bced2b1f25574d1bb7bae52210739243 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111cb0ca494adb4452cb66e4964c6b84aa9_del 2023-11-11 04:55:22,623 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111d0a1bc1da050432a890c3b137c9d235c 2023-11-11 04:55:22,806 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 04:55:22,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 04:55:22,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 04:55:22,807 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-11 04:55:23,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-11 04:55:23,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1699678512109-1699678522187 2023-11-11 04:55:23,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699678512109-1699678522187 2023-11-11 04:55:23,307 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 04:55:23,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 04:55:23,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 04:55:23,308 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-11 04:55:23,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699678512109-1699678522187 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/hbase-failsafe-snaptb-1699678512109-1699678522187 2023-11-11 04:55:23,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1699678512109-1699678522187 of table testCompactionWithHFileLink completed 2023-11-11 04:55:23,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699678512109-1699678522187 2023-11-11 04:55:23,453 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699678512109-1699678522187 2023-11-11 04:55:23,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1699678512109-1699678522187 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699678522203Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1699678522609 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1699678512109-1699678522187 at 1699678523027 (+418 ms)Loading Region manifests for hbase-failsafe-snaptb-1699678512109-1699678522187 at 1699678523028 (+1 ms)Writing data manifest for hbase-failsafe-snaptb-1699678512109-1699678522187 at 1699678523031 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1699678512109-1699678522187 at 1699678523437 (+406 ms)Snapshot hbase-failsafe-snaptb-1699678512109-1699678522187 of table testCompactionWithHFileLink completed at 1699678523452 (+15 ms) 2023-11-11 04:55:23,454 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 04:55:23,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2530 sec 2023-11-11 04:55:24,308 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 04:55:24,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 04:55:24,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1699678512109-1699678522187 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-11 04:55:24,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699678512109" table: "testCompactionWithHFileLink" creation_time: 1699678512119 type: FLUSH version: 2 ttl: 0 ) 2023-11-11 04:55:24,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1699678512109 as table=testCompactionWithHFileLink 2023-11-11 04:55:24,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-11 04:55:24,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-11 04:55:24,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-11 04:55:24,759 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-11 04:55:24,760 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-11 04:55:24,760 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-11 04:55:24,760 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 04:55:24,765 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1699678512109" table: "testCompactionWithHFileLink" creation_time: 1699678512119 type: FLUSH version: 2 ttl: 0 2023-11-11 04:55:24,765 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink 2023-11-11 04:55:24,770 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-11 04:55:24,773 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111aad4e5c4f3b3466cbebe7ec339656396 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111aad4e5c4f3b3466cbebe7ec339656396 2023-11-11 04:55:24,774 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111165dffe722f9144deb969f749c99d3c99 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111165dffe722f9144deb969f749c99d3c99 2023-11-11 04:55:24,775 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311112d15f8a210cd40acbeea2eabe5f9b38d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311112d15f8a210cd40acbeea2eabe5f9b38d 2023-11-11 04:55:24,775 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311114c27dcb5b95749b5b8fec200b71ee172 of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,778 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023111178caad0ad1cf418293d96cc7fb3f5378 of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,781 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231111e7d88fe71d9d44c4b10c40d15ee58632 of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,784 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231111f5382da71c6c4ae0a4c849e97191fab9 of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,786 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311110fdb441fa47c41deaca27867a85c5b93 of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,790 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311114672dc24b4d444349fca18ab7ab4a928 of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,793 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231111b619683a8f114e46a6961ac0addddaaf of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,795 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231111f5bb6de94a6e4ce487a84bc3e75606da of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,799 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023111115b461efbf6c454d9c6d99ee8e1a99b8 of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,802 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231111628ad76e6077411eba70094fbdba3545 of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,805 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231111af4a7071765b489580d599a0f4825e31 of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,807 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231111caed6a357ed943a28bdb4e86dc99a72c of snapshot=snaptb-1699678512109 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 04:55:24,813 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111cb0ca494adb4452cb66e4964c6b84aa9_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111cb0ca494adb4452cb66e4964c6b84aa9_del 2023-11-11 04:55:24,814 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111142ef47bd83454e1a9dda056334eaefa0_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111142ef47bd83454e1a9dda056334eaefa0_del 2023-11-11 04:55:24,815 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111ea2a840587f648e29af524b143a3f60e_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111ea2a840587f648e29af524b143a3f60e_del 2023-11-11 04:55:24,815 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:24,815 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:24,815 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:24,820 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/6829f8ed9faa4ffab54771582984e687 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/6829f8ed9faa4ffab54771582984e687 2023-11-11 04:55:24,820 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/277a8f5b22654b91b35aded69d6d045c_SeqId_29_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/277a8f5b22654b91b35aded69d6d045c_SeqId_29_ 2023-11-11 04:55:24,820 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/604d06f1c88c43aa9d94174d62456103_SeqId_29_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/604d06f1c88c43aa9d94174d62456103_SeqId_29_ 2023-11-11 04:55:24,822 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/175ada04d0254702a5110ea4503c4477_SeqId_29_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/175ada04d0254702a5110ea4503c4477_SeqId_29_ 2023-11-11 04:55:24,822 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 130eb83344b043c39e617cf762c1384d of snapshot=snaptb-1699678512109 to region=edd1396e4f13db5121a27e2b760689b0 table=testCompactionWithHFileLink 2023-11-11 04:55:24,822 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/638cdd24eb8c4fcf92a3b4e166875394 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/638cdd24eb8c4fcf92a3b4e166875394 2023-11-11 04:55:24,822 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/60d5dfc785f747b4836766e67b75a6a3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/60d5dfc785f747b4836766e67b75a6a3 2023-11-11 04:55:24,822 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f56fd7a3395d43f0a8a4b805c83f468f of snapshot=snaptb-1699678512109 to region=33b07a4e052e234a667f8fd20a21a8a8 table=testCompactionWithHFileLink 2023-11-11 04:55:24,822 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 16405ac9a365499f9f5faf021b56d1cf of snapshot=snaptb-1699678512109 to region=2e6918dc58f4aaaece8729bb59a834ed table=testCompactionWithHFileLink 2023-11-11 04:55:24,829 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d13db27086754f10abfc2f8b9784bba2 of snapshot=snaptb-1699678512109 to region=edd1396e4f13db5121a27e2b760689b0 table=testCompactionWithHFileLink 2023-11-11 04:55:24,834 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 56070528552f473f85235d97f88da6f9 of snapshot=snaptb-1699678512109 to region=33b07a4e052e234a667f8fd20a21a8a8 table=testCompactionWithHFileLink 2023-11-11 04:55:24,834 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 28367240a6564659b26a1497ebdc745c of snapshot=snaptb-1699678512109 to region=2e6918dc58f4aaaece8729bb59a834ed table=testCompactionWithHFileLink 2023-11-11 04:55:24,835 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7f9a11a16f5548698995bc9ef531ce9a of snapshot=snaptb-1699678512109 to region=edd1396e4f13db5121a27e2b760689b0 table=testCompactionWithHFileLink 2023-11-11 04:55:24,837 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f2d90811090543daa0c9af48ea406ae3 of snapshot=snaptb-1699678512109 to region=2e6918dc58f4aaaece8729bb59a834ed table=testCompactionWithHFileLink 2023-11-11 04:55:24,838 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f2e0c5b2c2324049be346d8ecaf99012 of snapshot=snaptb-1699678512109 to region=33b07a4e052e234a667f8fd20a21a8a8 table=testCompactionWithHFileLink 2023-11-11 04:55:24,838 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5ec341d2742c46378979d1289fa4b2f3 of snapshot=snaptb-1699678512109 to region=edd1396e4f13db5121a27e2b760689b0 table=testCompactionWithHFileLink 2023-11-11 04:55:24,841 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f7f70e6cdeb34eb4af2e12d03877f7ef of snapshot=snaptb-1699678512109 to region=2e6918dc58f4aaaece8729bb59a834ed table=testCompactionWithHFileLink 2023-11-11 04:55:24,841 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bf9d9322389446199459ec475a4182fb of snapshot=snaptb-1699678512109 to region=33b07a4e052e234a667f8fd20a21a8a8 table=testCompactionWithHFileLink 2023-11-11 04:55:24,844 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/22f9abca2302455f94a330f772bb68fc to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/22f9abca2302455f94a330f772bb68fc 2023-11-11 04:55:24,844 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b99159def6524322a8bb631204eb429f of snapshot=snaptb-1699678512109 to region=edd1396e4f13db5121a27e2b760689b0 table=testCompactionWithHFileLink 2023-11-11 04:55:24,847 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/903454b8a2ba475a9b2127878138866a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/903454b8a2ba475a9b2127878138866a 2023-11-11 04:55:24,847 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 19b17102fd1e4465825162c0692e474d of snapshot=snaptb-1699678512109 to region=2e6918dc58f4aaaece8729bb59a834ed table=testCompactionWithHFileLink 2023-11-11 04:55:24,849 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/e7bdcac848d046ec92ac01cd534c5056 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/e7bdcac848d046ec92ac01cd534c5056 2023-11-11 04:55:24,849 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0c94b698495645a380e12a9e6c768bea of snapshot=snaptb-1699678512109 to region=33b07a4e052e234a667f8fd20a21a8a8 table=testCompactionWithHFileLink 2023-11-11 04:55:24,857 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ad560bd65d1d41a9b263affab1c67608 of snapshot=snaptb-1699678512109 to region=edd1396e4f13db5121a27e2b760689b0 table=testCompactionWithHFileLink 2023-11-11 04:55:24,864 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 64f9c35100864faf98ee944976b8d698 of snapshot=snaptb-1699678512109 to region=33b07a4e052e234a667f8fd20a21a8a8 table=testCompactionWithHFileLink 2023-11-11 04:55:24,864 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a2276e6d835a4fc9844f3864abb06013 of snapshot=snaptb-1699678512109 to region=2e6918dc58f4aaaece8729bb59a834ed table=testCompactionWithHFileLink 2023-11-11 04:55:24,866 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 71cef7d3bb9d45d0982a108ae89701b9 of snapshot=snaptb-1699678512109 to region=edd1396e4f13db5121a27e2b760689b0 table=testCompactionWithHFileLink 2023-11-11 04:55:24,867 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a389ca6175d748b3a8f28aa471b4f54d of snapshot=snaptb-1699678512109 to region=33b07a4e052e234a667f8fd20a21a8a8 table=testCompactionWithHFileLink 2023-11-11 04:55:24,867 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3d126496eb57424ea45e6ab8b0e9a796 of snapshot=snaptb-1699678512109 to region=2e6918dc58f4aaaece8729bb59a834ed table=testCompactionWithHFileLink 2023-11-11 04:55:24,869 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4d7faf7097e046b88674840e9692e390 of snapshot=snaptb-1699678512109 to region=edd1396e4f13db5121a27e2b760689b0 table=testCompactionWithHFileLink 2023-11-11 04:55:24,871 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bf5f9e8ac56540e981b58e11f0cfd06e of snapshot=snaptb-1699678512109 to region=33b07a4e052e234a667f8fd20a21a8a8 table=testCompactionWithHFileLink 2023-11-11 04:55:24,871 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a9140b4dcf474b5fa4827e8e922d4240 of snapshot=snaptb-1699678512109 to region=2e6918dc58f4aaaece8729bb59a834ed table=testCompactionWithHFileLink 2023-11-11 04:55:24,875 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1699678512109" table: "testCompactionWithHFileLink" creation_time: 1699678512119 type: FLUSH version: 2 ttl: 0 2023-11-11 04:55:24,876 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699678524876"}]},"ts":"9223372036854775807"} 2023-11-11 04:55:24,876 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699678524876"}]},"ts":"9223372036854775807"} 2023-11-11 04:55:24,876 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699678524876"}]},"ts":"9223372036854775807"} 2023-11-11 04:55:24,878 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-11 04:55:24,878 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2e6918dc58f4aaaece8729bb59a834ed, NAME => 'testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 33b07a4e052e234a667f8fd20a21a8a8, NAME => 'testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => edd1396e4f13db5121a27e2b760689b0, NAME => 'testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-11 04:55:24,879 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678524877"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678524877"}]},"ts":"1699678524877"} 2023-11-11 04:55:24,879 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678524877"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678524877"}]},"ts":"1699678524877"} 2023-11-11 04:55:24,879 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678524877"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678524877"}]},"ts":"1699678524877"} 2023-11-11 04:55:24,880 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-11 04:55:24,880 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-11 04:55:24,880 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 2e6918dc58f4aaaece8729bb59a834ed, NAME => 'testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 33b07a4e052e234a667f8fd20a21a8a8, NAME => 'testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => edd1396e4f13db5121a27e2b760689b0, NAME => 'testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-11 04:55:24,881 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1699678512109 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-11 04:55:24,883 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699678512109" table: "testCompactionWithHFileLink" creation_time: 1699678512119 type: FLUSH version: 2 ttl: 0 ) in 542 msec 2023-11-11 04:55:24,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-11 04:55:24,956 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-11 04:55:24,956 INFO [Listener at localhost/35271] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1699678512109-1699678522187 2023-11-11 04:55:24,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1699678512109-1699678522187" 2023-11-11 04:55:24,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1699678512109-1699678522187 2023-11-11 04:55:24,964 INFO [Listener at localhost/35271] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-11 04:55:24,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-11 04:55:24,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-11 04:55:24,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-11 04:55:24,977 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-11 04:55:24,977 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678524977"}]},"ts":"1699678524977"} 2023-11-11 04:55:24,978 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-11 04:55:24,980 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-11 04:55:24,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=33b07a4e052e234a667f8fd20a21a8a8, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=edd1396e4f13db5121a27e2b760689b0, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2e6918dc58f4aaaece8729bb59a834ed, ASSIGN}] 2023-11-11 04:55:24,982 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=edd1396e4f13db5121a27e2b760689b0, ASSIGN 2023-11-11 04:55:24,982 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2e6918dc58f4aaaece8729bb59a834ed, ASSIGN 2023-11-11 04:55:24,982 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=33b07a4e052e234a667f8fd20a21a8a8, ASSIGN 2023-11-11 04:55:24,982 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=edd1396e4f13db5121a27e2b760689b0, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-11 04:55:24,982 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2e6918dc58f4aaaece8729bb59a834ed, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-11 04:55:24,982 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=33b07a4e052e234a667f8fd20a21a8a8, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-11 04:55:25,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-11 04:55:25,134 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=33b07a4e052e234a667f8fd20a21a8a8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:25,134 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2e6918dc58f4aaaece8729bb59a834ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:25,134 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=edd1396e4f13db5121a27e2b760689b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:25,134 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678525134"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678525134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678525134"}]},"ts":"1699678525134"} 2023-11-11 04:55:25,134 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678525134"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678525134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678525134"}]},"ts":"1699678525134"} 2023-11-11 04:55:25,134 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678525134"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678525134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678525134"}]},"ts":"1699678525134"} 2023-11-11 04:55:25,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure 33b07a4e052e234a667f8fd20a21a8a8, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:25,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure edd1396e4f13db5121a27e2b760689b0, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:25,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure 2e6918dc58f4aaaece8729bb59a834ed, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:25,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-11 04:55:25,287 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:25,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:25,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2e6918dc58f4aaaece8729bb59a834ed, NAME => 'testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.', STARTKEY => '2', ENDKEY => ''} 2023-11-11 04:55:25,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:25,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:25,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:25,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:25,291 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:25,292 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1 2023-11-11 04:55:25,292 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1 2023-11-11 04:55:25,293 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e6918dc58f4aaaece8729bb59a834ed columnFamilyName family1 2023-11-11 04:55:25,302 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-16405ac9a365499f9f5faf021b56d1cf 2023-11-11 04:55:25,307 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-28367240a6564659b26a1497ebdc745c 2023-11-11 04:55:25,312 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f2d90811090543daa0c9af48ea406ae3 2023-11-11 04:55:25,317 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f7f70e6cdeb34eb4af2e12d03877f7ef 2023-11-11 04:55:25,317 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(310): Store=2e6918dc58f4aaaece8729bb59a834ed/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:25,317 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:25,318 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2 2023-11-11 04:55:25,318 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2 2023-11-11 04:55:25,319 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e6918dc58f4aaaece8729bb59a834ed columnFamilyName family2 2023-11-11 04:55:25,324 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-19b17102fd1e4465825162c0692e474d 2023-11-11 04:55:25,329 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-3d126496eb57424ea45e6ab8b0e9a796 2023-11-11 04:55:25,333 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a2276e6d835a4fc9844f3864abb06013 2023-11-11 04:55:25,339 DEBUG [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a9140b4dcf474b5fa4827e8e922d4240 2023-11-11 04:55:25,339 INFO [StoreOpener-2e6918dc58f4aaaece8729bb59a834ed-1] regionserver.HStore(310): Store=2e6918dc58f4aaaece8729bb59a834ed/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:25,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:25,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:25,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:25,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:55:25,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2e6918dc58f4aaaece8729bb59a834ed; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68761114, jitterRate=0.02462044358253479}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:25,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:25,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed., pid=103, masterSystemTime=1699678525287 2023-11-11 04:55:25,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:55:25,347 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-11 04:55:25,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-11 04:55:25,347 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-11 04:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:25,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:25,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 33b07a4e052e234a667f8fd20a21a8a8, NAME => 'testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.', STARTKEY => '', ENDKEY => '1'} 2023-11-11 04:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:25,349 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2e6918dc58f4aaaece8729bb59a834ed, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:25,350 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678525349"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678525349"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678525349"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678525349"}]},"ts":"1699678525349"} 2023-11-11 04:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:25,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:25,351 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-11 04:55:25,352 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1912): 2e6918dc58f4aaaece8729bb59a834ed/family1 is initiating minor compaction (all files) 2023-11-11 04:55:25,352 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2e6918dc58f4aaaece8729bb59a834ed/family1 in testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:25,352 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-16405ac9a365499f9f5faf021b56d1cf, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-28367240a6564659b26a1497ebdc745c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f2d90811090543daa0c9af48ea406ae3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f7f70e6cdeb34eb4af2e12d03877f7ef] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp, totalSize=21.6 K 2023-11-11 04:55:25,352 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-11 04:55:25,352 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HStore(1912): 2e6918dc58f4aaaece8729bb59a834ed/family2 is initiating minor compaction (all files) 2023-11-11 04:55:25,352 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 2e6918dc58f4aaaece8729bb59a834ed/family2 in testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:55:25,352 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-19b17102fd1e4465825162c0692e474d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a2276e6d835a4fc9844f3864abb06013, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-3d126496eb57424ea45e6ab8b0e9a796, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a9140b4dcf474b5fa4827e8e922d4240] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp, totalSize=20.4 K 2023-11-11 04:55:25,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-11-11 04:55:25,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure 2e6918dc58f4aaaece8729bb59a834ed, server=jenkins-hbase4.apache.org,43941,1699678403879 in 214 msec 2023-11-11 04:55:25,353 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-16405ac9a365499f9f5faf021b56d1cf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505332 2023-11-11 04:55:25,353 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-19b17102fd1e4465825162c0692e474d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505332 2023-11-11 04:55:25,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2e6918dc58f4aaaece8729bb59a834ed, ASSIGN in 373 msec 2023-11-11 04:55:25,354 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-28367240a6564659b26a1497ebdc745c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507116 2023-11-11 04:55:25,353 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:25,354 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a2276e6d835a4fc9844f3864abb06013, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507116 2023-11-11 04:55:25,354 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f2d90811090543daa0c9af48ea406ae3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:25,357 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1 2023-11-11 04:55:25,357 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1 2023-11-11 04:55:25,357 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f7f70e6cdeb34eb4af2e12d03877f7ef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510304 2023-11-11 04:55:25,357 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-3d126496eb57424ea45e6ab8b0e9a796, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:25,358 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33b07a4e052e234a667f8fd20a21a8a8 columnFamilyName family1 2023-11-11 04:55:25,360 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a9140b4dcf474b5fa4827e8e922d4240, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510304 2023-11-11 04:55:25,377 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-56070528552f473f85235d97f88da6f9 2023-11-11 04:55:25,389 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf9d9322389446199459ec475a4182fb 2023-11-11 04:55:25,404 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f2e0c5b2c2324049be346d8ecaf99012 2023-11-11 04:55:25,404 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2e6918dc58f4aaaece8729bb59a834ed#family1#compaction#114 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 76.92 MB/second 2023-11-11 04:55:25,412 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] throttle.PressureAwareThroughputController(145): 2e6918dc58f4aaaece8729bb59a834ed#family2#compaction#115 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-11 04:55:25,415 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f56fd7a3395d43f0a8a4b805c83f468f 2023-11-11 04:55:25,417 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(310): Store=33b07a4e052e234a667f8fd20a21a8a8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:25,417 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:25,420 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2 2023-11-11 04:55:25,420 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2 2023-11-11 04:55:25,420 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33b07a4e052e234a667f8fd20a21a8a8 columnFamilyName family2 2023-11-11 04:55:25,431 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-0c94b698495645a380e12a9e6c768bea 2023-11-11 04:55:25,436 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-64f9c35100864faf98ee944976b8d698 2023-11-11 04:55:25,441 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-a389ca6175d748b3a8f28aa471b4f54d 2023-11-11 04:55:25,447 DEBUG [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf5f9e8ac56540e981b58e11f0cfd06e 2023-11-11 04:55:25,447 INFO [StoreOpener-33b07a4e052e234a667f8fd20a21a8a8-1] regionserver.HStore(310): Store=33b07a4e052e234a667f8fd20a21a8a8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:25,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:25,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:25,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:25,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:55:25,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 33b07a4e052e234a667f8fd20a21a8a8; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69970851, jitterRate=0.04264692962169647}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:25,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:25,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8., pid=101, masterSystemTime=1699678525287 2023-11-11 04:55:25,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-11 04:55:25,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-11 04:55:25,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:25,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:25,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:25,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => edd1396e4f13db5121a27e2b760689b0, NAME => 'testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.', STARTKEY => '1', ENDKEY => '2'} 2023-11-11 04:55:25,456 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=33b07a4e052e234a667f8fd20a21a8a8, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:25,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:25,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:25,457 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699678525456"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678525456"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678525456"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678525456"}]},"ts":"1699678525456"} 2023-11-11 04:55:25,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:25,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:25,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=98 2023-11-11 04:55:25,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure 33b07a4e052e234a667f8fd20a21a8a8, server=jenkins-hbase4.apache.org,43941,1699678403879 in 322 msec 2023-11-11 04:55:25,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=33b07a4e052e234a667f8fd20a21a8a8, ASSIGN in 479 msec 2023-11-11 04:55:25,461 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:25,462 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1 2023-11-11 04:55:25,462 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1 2023-11-11 04:55:25,462 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region edd1396e4f13db5121a27e2b760689b0 columnFamilyName family1 2023-11-11 04:55:25,471 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-130eb83344b043c39e617cf762c1384d 2023-11-11 04:55:25,476 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-5ec341d2742c46378979d1289fa4b2f3 2023-11-11 04:55:25,481 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-7f9a11a16f5548698995bc9ef531ce9a 2023-11-11 04:55:25,490 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-d13db27086754f10abfc2f8b9784bba2 2023-11-11 04:55:25,490 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(310): Store=edd1396e4f13db5121a27e2b760689b0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:25,490 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:25,491 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2 2023-11-11 04:55:25,491 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2 2023-11-11 04:55:25,492 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region edd1396e4f13db5121a27e2b760689b0 columnFamilyName family2 2023-11-11 04:55:25,502 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-4d7faf7097e046b88674840e9692e390 2023-11-11 04:55:25,509 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-71cef7d3bb9d45d0982a108ae89701b9 2023-11-11 04:55:25,516 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-ad560bd65d1d41a9b263affab1c67608 2023-11-11 04:55:25,521 DEBUG [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(539): loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-b99159def6524322a8bb631204eb429f 2023-11-11 04:55:25,522 INFO [StoreOpener-edd1396e4f13db5121a27e2b760689b0-1] regionserver.HStore(310): Store=edd1396e4f13db5121a27e2b760689b0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:25,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:25,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:25,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:25,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:55:25,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened edd1396e4f13db5121a27e2b760689b0; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60433922, jitterRate=-0.09946438670158386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:25,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:25,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0., pid=102, masterSystemTime=1699678525287 2023-11-11 04:55:25,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-11 04:55:25,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-11 04:55:25,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:25,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:25,531 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=edd1396e4f13db5121a27e2b760689b0, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:25,531 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678525531"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678525531"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678525531"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678525531"}]},"ts":"1699678525531"} 2023-11-11 04:55:25,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=99 2023-11-11 04:55:25,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure edd1396e4f13db5121a27e2b760689b0, server=jenkins-hbase4.apache.org,43941,1699678403879 in 397 msec 2023-11-11 04:55:25,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=99, resume processing ppid=97 2023-11-11 04:55:25,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=edd1396e4f13db5121a27e2b760689b0, ASSIGN in 554 msec 2023-11-11 04:55:25,536 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678525536"}]},"ts":"1699678525536"} 2023-11-11 04:55:25,537 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-11 04:55:25,539 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-11 04:55:25,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 570 msec 2023-11-11 04:55:25,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-11 04:55:25,580 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-11 04:55:25,598 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:25,609 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:25,617 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-11-11 04:55:25,620 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:25,621 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:25,628 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 04:55:25,644 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-11 04:55:25,644 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:25,645 DEBUG [Listener at localhost/35271] zookeeper.ReadOnlyZKClient(139): Connect 0x27aeca0b to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:55:25,649 DEBUG [Listener at localhost/35271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28185a46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:55:25,650 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:25,650 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:25,650 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:26,133 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311110943f0f9d8d9430ca6be793b97cba278 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311110943f0f9d8d9430ca6be793b97cba278 2023-11-11 04:55:26,134 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:26,146 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:55:26,149 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:55:26,156 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:55:26,159 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:55:26,167 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/693d7c509b744fafa646e0b324e166a7 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-11 04:55:26,167 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/693d7c509b744fafa646e0b324e166a7}] 2023-11-11 04:55:26,172 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/693d7c509b744fafa646e0b324e166a7 for inclusion in 2e6918dc58f4aaaece8729bb59a834ed/family1 2023-11-11 04:55:26,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-11 04:55:26,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-11 04:55:26,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:26,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/693d7c509b744fafa646e0b324e166a7 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__9eihfrr4u5jg6qbbklqre2sp5ueg4m5q9rgmop573tju2kmh2e9lvd2jk93d36fh/family1/693d7c509b744fafa646e0b324e166a7 2023-11-11 04:55:26,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__9eihfrr4u5jg6qbbklqre2sp5ueg4m5q9rgmop573tju2kmh2e9lvd2jk93d36fh/family1/693d7c509b744fafa646e0b324e166a7 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/95435efcf4404b0ebd30c496f1586d75_SeqId_34_ 2023-11-11 04:55:26,177 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__9eihfrr4u5jg6qbbklqre2sp5ueg4m5q9rgmop573tju2kmh2e9lvd2jk93d36fh/family1/693d7c509b744fafa646e0b324e166a7 into 2e6918dc58f4aaaece8729bb59a834ed/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/95435efcf4404b0ebd30c496f1586d75_SeqId_34_ - updating store file list. 2023-11-11 04:55:26,181 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/95435efcf4404b0ebd30c496f1586d75_SeqId_34_ into 2e6918dc58f4aaaece8729bb59a834ed/family1 2023-11-11 04:55:26,181 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__9eihfrr4u5jg6qbbklqre2sp5ueg4m5q9rgmop573tju2kmh2e9lvd2jk93d36fh/family1/693d7c509b744fafa646e0b324e166a7 into 2e6918dc58f4aaaece8729bb59a834ed/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/95435efcf4404b0ebd30c496f1586d75_SeqId_34_) 2023-11-11 04:55:26,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__9eihfrr4u5jg6qbbklqre2sp5ueg4m5q9rgmop573tju2kmh2e9lvd2jk93d36fh/family1/693d7c509b744fafa646e0b324e166a7 2023-11-11 04:55:26,183 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:26,184 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:26,186 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311110fdb441fa47c41deaca27867a85c5b93 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311110fdb441fa47c41deaca27867a85c5b93 2023-11-11 04:55:26,187 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311114672dc24b4d444349fca18ab7ab4a928 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311114672dc24b4d444349fca18ab7ab4a928 2023-11-11 04:55:26,188 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231111b619683a8f114e46a6961ac0addddaaf to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231111b619683a8f114e46a6961ac0addddaaf 2023-11-11 04:55:26,189 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231111f5bb6de94a6e4ce487a84bc3e75606da to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231111f5bb6de94a6e4ce487a84bc3e75606da 2023-11-11 04:55:26,189 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 04:55:26,189 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111' 2023-11-11 04:55:26,190 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:26,530 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111755974bb2bec49f6948f58898b6a3055 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111755974bb2bec49f6948f58898b6a3055 2023-11-11 04:55:26,531 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:26,534 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111bc01822b5f004f5785ecd97447c9b4c6 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111bc01822b5f004f5785ecd97447c9b4c6 2023-11-11 04:55:26,535 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:26,562 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/35f119d6f05441d489777a4bec1fbe9f first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-11 04:55:26,563 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/35f119d6f05441d489777a4bec1fbe9f}] 2023-11-11 04:55:26,565 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/35f119d6f05441d489777a4bec1fbe9f for inclusion in edd1396e4f13db5121a27e2b760689b0/family1 2023-11-11 04:55:26,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-11 04:55:26,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-11 04:55:26,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:26,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/35f119d6f05441d489777a4bec1fbe9f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__d2fbtpvba0mp4pqm491imr2n7piet2a3i27njrclp2cta41h2e42ird5njpd1phm/family1/35f119d6f05441d489777a4bec1fbe9f 2023-11-11 04:55:26,575 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/8b707688df7643fbbebe2048db5b3eb3 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-11 04:55:26,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__d2fbtpvba0mp4pqm491imr2n7piet2a3i27njrclp2cta41h2e42ird5njpd1phm/family1/35f119d6f05441d489777a4bec1fbe9f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/1f6c6ae29d1e4053878dc76a0531b66a_SeqId_34_ 2023-11-11 04:55:26,576 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=32 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/8b707688df7643fbbebe2048db5b3eb3}] 2023-11-11 04:55:26,576 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__d2fbtpvba0mp4pqm491imr2n7piet2a3i27njrclp2cta41h2e42ird5njpd1phm/family1/35f119d6f05441d489777a4bec1fbe9f into edd1396e4f13db5121a27e2b760689b0/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/1f6c6ae29d1e4053878dc76a0531b66a_SeqId_34_ - updating store file list. 2023-11-11 04:55:26,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/8b707688df7643fbbebe2048db5b3eb3 for inclusion in 33b07a4e052e234a667f8fd20a21a8a8/family1 2023-11-11 04:55:26,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-11 04:55:26,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last=1 2023-11-11 04:55:26,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:26,582 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/1f6c6ae29d1e4053878dc76a0531b66a_SeqId_34_ into edd1396e4f13db5121a27e2b760689b0/family1 2023-11-11 04:55:26,582 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__d2fbtpvba0mp4pqm491imr2n7piet2a3i27njrclp2cta41h2e42ird5njpd1phm/family1/35f119d6f05441d489777a4bec1fbe9f into edd1396e4f13db5121a27e2b760689b0/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/1f6c6ae29d1e4053878dc76a0531b66a_SeqId_34_) 2023-11-11 04:55:26,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/8b707688df7643fbbebe2048db5b3eb3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__603qu6ijoeldr8ii54uhsnqhpiu9rul3kvnp9i0djit1ohomeibhs4g416f1bj2f/family1/8b707688df7643fbbebe2048db5b3eb3 2023-11-11 04:55:26,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__d2fbtpvba0mp4pqm491imr2n7piet2a3i27njrclp2cta41h2e42ird5njpd1phm/family1/35f119d6f05441d489777a4bec1fbe9f 2023-11-11 04:55:26,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:26,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__603qu6ijoeldr8ii54uhsnqhpiu9rul3kvnp9i0djit1ohomeibhs4g416f1bj2f/family1/8b707688df7643fbbebe2048db5b3eb3 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/4b8a6a73cbdd4fb2875fbfc184da1516_SeqId_34_ 2023-11-11 04:55:26,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__603qu6ijoeldr8ii54uhsnqhpiu9rul3kvnp9i0djit1ohomeibhs4g416f1bj2f/family1/8b707688df7643fbbebe2048db5b3eb3 into 33b07a4e052e234a667f8fd20a21a8a8/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/4b8a6a73cbdd4fb2875fbfc184da1516_SeqId_34_ - updating store file list. 2023-11-11 04:55:26,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-11 04:55:26,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(1912): edd1396e4f13db5121a27e2b760689b0/family1 is initiating minor compaction (all files) 2023-11-11 04:55:26,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3fa185aa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-11 04:55:26,588 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:26,589 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:26,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/4b8a6a73cbdd4fb2875fbfc184da1516_SeqId_34_ into 33b07a4e052e234a667f8fd20a21a8a8/family1 2023-11-11 04:55:26,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__603qu6ijoeldr8ii54uhsnqhpiu9rul3kvnp9i0djit1ohomeibhs4g416f1bj2f/family1/8b707688df7643fbbebe2048db5b3eb3 into 33b07a4e052e234a667f8fd20a21a8a8/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/4b8a6a73cbdd4fb2875fbfc184da1516_SeqId_34_) 2023-11-11 04:55:26,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testCompactionWithHFileLink__603qu6ijoeldr8ii54uhsnqhpiu9rul3kvnp9i0djit1ohomeibhs4g416f1bj2f/family1/8b707688df7643fbbebe2048db5b3eb3 2023-11-11 04:55:26,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:26,591 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311114c27dcb5b95749b5b8fec200b71ee172 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311114c27dcb5b95749b5b8fec200b71ee172 2023-11-11 04:55:26,592 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111178caad0ad1cf418293d96cc7fb3f5378 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111178caad0ad1cf418293d96cc7fb3f5378 2023-11-11 04:55:26,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-11 04:55:26,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(1912): 33b07a4e052e234a667f8fd20a21a8a8/family1 is initiating minor compaction (all files) 2023-11-11 04:55:26,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@35fa56f3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-11 04:55:26,593 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231111e7d88fe71d9d44c4b10c40d15ee58632 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231111e7d88fe71d9d44c4b10c40d15ee58632 2023-11-11 04:55:26,595 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231111f5382da71c6c4ae0a4c849e97191fab9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231111f5382da71c6c4ae0a4c849e97191fab9 2023-11-11 04:55:26,595 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 04:55:26,595 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111' 2023-11-11 04:55:26,595 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:26,595 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:26,596 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:26,597 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111115b461efbf6c454d9c6d99ee8e1a99b8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111115b461efbf6c454d9c6d99ee8e1a99b8 2023-11-11 04:55:26,598 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231111628ad76e6077411eba70094fbdba3545 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231111628ad76e6077411eba70094fbdba3545 2023-11-11 04:55:26,599 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231111af4a7071765b489580d599a0f4825e31 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231111af4a7071765b489580d599a0f4825e31 2023-11-11 04:55:26,600 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231111caed6a357ed943a28bdb4e86dc99a72c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231111caed6a357ed943a28bdb4e86dc99a72c 2023-11-11 04:55:26,600 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 04:55:26,600 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111' 2023-11-11 04:55:26,600 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 04:55:26,600 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-11 04:55:26,603 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:26,605 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:26,607 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:26,609 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:26,615 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:26,615 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:26,633 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family1/bdd50bd90f234f3fb3585ba5a4678d83 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/bdd50bd90f234f3fb3585ba5a4678d83 2023-11-11 04:55:26,635 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=293 (was 240) - Thread LEAK? -, OpenFileDescriptor=801 (was 625) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 135) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 169), AvailableMemoryMB=2343 (was 1953) - AvailableMemoryMB LEAK? - 2023-11-11 04:55:26,642 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 2e6918dc58f4aaaece8729bb59a834ed/family1 of 2e6918dc58f4aaaece8729bb59a834ed into bdd50bd90f234f3fb3585ba5a4678d83(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:55:26,642 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:26,642 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed., storeName=2e6918dc58f4aaaece8729bb59a834ed/family1, priority=12, startTime=1699678525346; duration=1sec 2023-11-11 04:55:26,643 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-11 04:55:26,643 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of edd1396e4f13db5121a27e2b760689b0/family1 in testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:26,643 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-130eb83344b043c39e617cf762c1384d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-d13db27086754f10abfc2f8b9784bba2, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-7f9a11a16f5548698995bc9ef531ce9a, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-5ec341d2742c46378979d1289fa4b2f3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/1f6c6ae29d1e4053878dc76a0531b66a_SeqId_34_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp, totalSize=28.9 K 2023-11-11 04:55:26,643 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-130eb83344b043c39e617cf762c1384d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505332 2023-11-11 04:55:26,643 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/.tmp/family2/2e268387392241989e865134b74462be as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/2e268387392241989e865134b74462be 2023-11-11 04:55:26,644 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-d13db27086754f10abfc2f8b9784bba2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507115 2023-11-11 04:55:26,645 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-7f9a11a16f5548698995bc9ef531ce9a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:26,646 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-5ec341d2742c46378979d1289fa4b2f3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510303 2023-11-11 04:55:26,646 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 1f6c6ae29d1e4053878dc76a0531b66a_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1699678505332 2023-11-11 04:55:26,648 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 2e6918dc58f4aaaece8729bb59a834ed/family2 of 2e6918dc58f4aaaece8729bb59a834ed into 2e268387392241989e865134b74462be(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:55:26,648 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:55:26,648 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed., storeName=2e6918dc58f4aaaece8729bb59a834ed/family2, priority=12, startTime=1699678525347; duration=1sec 2023-11-11 04:55:26,649 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-11 04:55:26,649 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 33b07a4e052e234a667f8fd20a21a8a8/family1 in testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:26,649 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f56fd7a3395d43f0a8a4b805c83f468f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-56070528552f473f85235d97f88da6f9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f2e0c5b2c2324049be346d8ecaf99012, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf9d9322389446199459ec475a4182fb, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/4b8a6a73cbdd4fb2875fbfc184da1516_SeqId_34_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp, totalSize=28.9 K 2023-11-11 04:55:26,649 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=291, OpenFileDescriptor=803, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=167, AvailableMemoryMB=2351 2023-11-11 04:55:26,651 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f56fd7a3395d43f0a8a4b805c83f468f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505330 2023-11-11 04:55:26,652 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-56070528552f473f85235d97f88da6f9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507115 2023-11-11 04:55:26,652 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f2e0c5b2c2324049be346d8ecaf99012, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:26,653 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf9d9322389446199459ec475a4182fb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510303 2023-11-11 04:55:26,653 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting 4b8a6a73cbdd4fb2875fbfc184da1516_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1699678505330 2023-11-11 04:55:26,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-11 04:55:26,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-11 04:55:26,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-11 04:55:26,662 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-11 04:55:26,664 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): edd1396e4f13db5121a27e2b760689b0#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-11 04:55:26,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-11-11 04:55:26,669 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] throttle.PressureAwareThroughputController(145): 33b07a4e052e234a667f8fd20a21a8a8#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-11 04:55:26,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-16405ac9a365499f9f5faf021b56d1cf, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-28367240a6564659b26a1497ebdc745c, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f2d90811090543daa0c9af48ea406ae3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f7f70e6cdeb34eb4af2e12d03877f7ef] to archive 2023-11-11 04:55:26,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:26,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-16405ac9a365499f9f5faf021b56d1cf to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-16405ac9a365499f9f5faf021b56d1cf 2023-11-11 04:55:26,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-28367240a6564659b26a1497ebdc745c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-28367240a6564659b26a1497ebdc745c 2023-11-11 04:55:26,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f2d90811090543daa0c9af48ea406ae3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f2d90811090543daa0c9af48ea406ae3 2023-11-11 04:55:26,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f7f70e6cdeb34eb4af2e12d03877f7ef to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family1/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-f7f70e6cdeb34eb4af2e12d03877f7ef 2023-11-11 04:55:26,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-19b17102fd1e4465825162c0692e474d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a2276e6d835a4fc9844f3864abb06013, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-3d126496eb57424ea45e6ab8b0e9a796, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a9140b4dcf474b5fa4827e8e922d4240] to archive 2023-11-11 04:55:26,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:26,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-19b17102fd1e4465825162c0692e474d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-19b17102fd1e4465825162c0692e474d 2023-11-11 04:55:26,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a2276e6d835a4fc9844f3864abb06013 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a2276e6d835a4fc9844f3864abb06013 2023-11-11 04:55:26,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-3d126496eb57424ea45e6ab8b0e9a796 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-3d126496eb57424ea45e6ab8b0e9a796 2023-11-11 04:55:26,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a9140b4dcf474b5fa4827e8e922d4240 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/family2/testCompactionWithHFileLink=2e6918dc58f4aaaece8729bb59a834ed-a9140b4dcf474b5fa4827e8e922d4240 2023-11-11 04:55:26,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-11 04:55:26,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-11 04:55:26,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-11 04:55:26,765 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:55:26,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-11 04:55:26,766 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:55:26,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 04:55:26,768 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029 2023-11-11 04:55:26,768 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510 2023-11-11 04:55:26,768 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d 2023-11-11 04:55:26,768 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029 empty. 2023-11-11 04:55:26,768 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510 empty. 2023-11-11 04:55:26,768 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d empty. 2023-11-11 04:55:26,769 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029 2023-11-11 04:55:26,769 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510 2023-11-11 04:55:26,769 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d 2023-11-11 04:55:26,769 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-11 04:55:26,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 04:55:27,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 04:55:27,175 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-11 04:55:27,177 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 4d006bc838d3353e4d8b7fad62c39f9d, NAME => 'ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:55:27,177 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => d33048759c13f557d932f58e5b37d029, NAME => 'ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:55:27,177 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9935958aa309b992cb5f336e4bc6f510, NAME => 'ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:55:27,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 04:55:27,482 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family1/24acd78cf7d547deadcb57b025f3f262 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/24acd78cf7d547deadcb57b025f3f262 2023-11-11 04:55:27,484 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family1/d5d5ff15f7ca40638498030e2bfd05e4 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/d5d5ff15f7ca40638498030e2bfd05e4 2023-11-11 04:55:27,486 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in edd1396e4f13db5121a27e2b760689b0/family1 of edd1396e4f13db5121a27e2b760689b0 into 24acd78cf7d547deadcb57b025f3f262(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:55:27,487 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:27,487 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1699678526586; duration=0sec 2023-11-11 04:55:27,487 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-11 04:55:27,487 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-11 04:55:27,489 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 33b07a4e052e234a667f8fd20a21a8a8/family1 of 33b07a4e052e234a667f8fd20a21a8a8 into d5d5ff15f7ca40638498030e2bfd05e4(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:55:27,489 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:27,489 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1699678526593; duration=0sec 2023-11-11 04:55:27,489 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-11 04:55:27,489 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-11 04:55:27,489 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-11 04:55:27,489 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1912): 33b07a4e052e234a667f8fd20a21a8a8/family2 is initiating minor compaction (all files) 2023-11-11 04:55:27,489 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 33b07a4e052e234a667f8fd20a21a8a8/family2 in testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:55:27,489 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-0c94b698495645a380e12a9e6c768bea, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-64f9c35100864faf98ee944976b8d698, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-a389ca6175d748b3a8f28aa471b4f54d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf5f9e8ac56540e981b58e11f0cfd06e] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp, totalSize=20.4 K 2023-11-11 04:55:27,490 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-0c94b698495645a380e12a9e6c768bea, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505330 2023-11-11 04:55:27,491 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-64f9c35100864faf98ee944976b8d698, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507115 2023-11-11 04:55:27,491 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-11 04:55:27,491 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-a389ca6175d748b3a8f28aa471b4f54d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:27,491 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HStore(1912): edd1396e4f13db5121a27e2b760689b0/family2 is initiating minor compaction (all files) 2023-11-11 04:55:27,491 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HRegion(2259): Starting compaction of edd1396e4f13db5121a27e2b760689b0/family2 in testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:55:27,492 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-b99159def6524322a8bb631204eb429f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-ad560bd65d1d41a9b263affab1c67608, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-71cef7d3bb9d45d0982a108ae89701b9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-4d7faf7097e046b88674840e9692e390] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp, totalSize=20.4 K 2023-11-11 04:55:27,492 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf5f9e8ac56540e981b58e11f0cfd06e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510303 2023-11-11 04:55:27,493 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-b99159def6524322a8bb631204eb429f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678505332 2023-11-11 04:55:27,493 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-ad560bd65d1d41a9b263affab1c67608, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678507115 2023-11-11 04:55:27,494 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-71cef7d3bb9d45d0982a108ae89701b9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678508900 2023-11-11 04:55:27,494 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-4d7faf7097e046b88674840e9692e390, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678510303 2023-11-11 04:55:27,504 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): 33b07a4e052e234a667f8fd20a21a8a8#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-11-11 04:55:27,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-130eb83344b043c39e617cf762c1384d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-d13db27086754f10abfc2f8b9784bba2, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-7f9a11a16f5548698995bc9ef531ce9a, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-5ec341d2742c46378979d1289fa4b2f3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/1f6c6ae29d1e4053878dc76a0531b66a_SeqId_34_] to archive 2023-11-11 04:55:27,506 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] throttle.PressureAwareThroughputController(145): edd1396e4f13db5121a27e2b760689b0#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-11 04:55:27,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:27,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-130eb83344b043c39e617cf762c1384d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-130eb83344b043c39e617cf762c1384d 2023-11-11 04:55:27,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-d13db27086754f10abfc2f8b9784bba2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-d13db27086754f10abfc2f8b9784bba2 2023-11-11 04:55:27,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-7f9a11a16f5548698995bc9ef531ce9a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-7f9a11a16f5548698995bc9ef531ce9a 2023-11-11 04:55:27,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-5ec341d2742c46378979d1289fa4b2f3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-5ec341d2742c46378979d1289fa4b2f3 2023-11-11 04:55:27,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/1f6c6ae29d1e4053878dc76a0531b66a_SeqId_34_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family1/1f6c6ae29d1e4053878dc76a0531b66a_SeqId_34_ 2023-11-11 04:55:27,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f56fd7a3395d43f0a8a4b805c83f468f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-56070528552f473f85235d97f88da6f9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f2e0c5b2c2324049be346d8ecaf99012, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf9d9322389446199459ec475a4182fb, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/4b8a6a73cbdd4fb2875fbfc184da1516_SeqId_34_] to archive 2023-11-11 04:55:27,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:27,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f56fd7a3395d43f0a8a4b805c83f468f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f56fd7a3395d43f0a8a4b805c83f468f 2023-11-11 04:55:27,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-56070528552f473f85235d97f88da6f9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-56070528552f473f85235d97f88da6f9 2023-11-11 04:55:27,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f2e0c5b2c2324049be346d8ecaf99012 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-f2e0c5b2c2324049be346d8ecaf99012 2023-11-11 04:55:27,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf9d9322389446199459ec475a4182fb to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf9d9322389446199459ec475a4182fb 2023-11-11 04:55:27,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/4b8a6a73cbdd4fb2875fbfc184da1516_SeqId_34_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family1/4b8a6a73cbdd4fb2875fbfc184da1516_SeqId_34_ 2023-11-11 04:55:27,542 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:55:27,586 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:27,586 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:27,586 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 9935958aa309b992cb5f336e4bc6f510, disabling compactions & flushes 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing d33048759c13f557d932f58e5b37d029, disabling compactions & flushes 2023-11-11 04:55:27,587 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:27,587 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. after waiting 0 ms 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 4d006bc838d3353e4d8b7fad62c39f9d, disabling compactions & flushes 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:27,587 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. after waiting 0 ms 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 9935958aa309b992cb5f336e4bc6f510: 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:27,587 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:27,587 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for d33048759c13f557d932f58e5b37d029: 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. after waiting 0 ms 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:27,587 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:27,587 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 4d006bc838d3353e4d8b7fad62c39f9d: 2023-11-11 04:55:27,589 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:55:27,590 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699678527590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678527590"}]},"ts":"1699678527590"} 2023-11-11 04:55:27,590 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699678527590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678527590"}]},"ts":"1699678527590"} 2023-11-11 04:55:27,590 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699678527590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678527590"}]},"ts":"1699678527590"} 2023-11-11 04:55:27,592 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-11 04:55:27,593 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:55:27,593 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678527593"}]},"ts":"1699678527593"} 2023-11-11 04:55:27,594 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-11 04:55:27,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d33048759c13f557d932f58e5b37d029, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9935958aa309b992cb5f336e4bc6f510, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4d006bc838d3353e4d8b7fad62c39f9d, ASSIGN}] 2023-11-11 04:55:27,607 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4d006bc838d3353e4d8b7fad62c39f9d, ASSIGN 2023-11-11 04:55:27,607 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9935958aa309b992cb5f336e4bc6f510, ASSIGN 2023-11-11 04:55:27,607 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d33048759c13f557d932f58e5b37d029, ASSIGN 2023-11-11 04:55:27,608 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4d006bc838d3353e4d8b7fad62c39f9d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:55:27,608 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9935958aa309b992cb5f336e4bc6f510, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:55:27,608 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d33048759c13f557d932f58e5b37d029, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:55:27,760 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=4d006bc838d3353e4d8b7fad62c39f9d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:27,760 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9935958aa309b992cb5f336e4bc6f510, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:27,760 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d33048759c13f557d932f58e5b37d029, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:27,760 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699678527760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678527760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678527760"}]},"ts":"1699678527760"} 2023-11-11 04:55:27,761 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699678527760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678527760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678527760"}]},"ts":"1699678527760"} 2023-11-11 04:55:27,761 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699678527760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678527760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678527760"}]},"ts":"1699678527760"} 2023-11-11 04:55:27,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 4d006bc838d3353e4d8b7fad62c39f9d, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:27,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 9935958aa309b992cb5f336e4bc6f510, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:27,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure d33048759c13f557d932f58e5b37d029, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:27,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 04:55:27,913 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:27,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:27,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9935958aa309b992cb5f336e4bc6f510, NAME => 'ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510.', STARTKEY => '1', ENDKEY => '2'} 2023-11-11 04:55:27,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 9935958aa309b992cb5f336e4bc6f510 2023-11-11 04:55:27,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:27,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9935958aa309b992cb5f336e4bc6f510 2023-11-11 04:55:27,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9935958aa309b992cb5f336e4bc6f510 2023-11-11 04:55:27,918 INFO [StoreOpener-9935958aa309b992cb5f336e4bc6f510-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9935958aa309b992cb5f336e4bc6f510 2023-11-11 04:55:27,919 DEBUG [StoreOpener-9935958aa309b992cb5f336e4bc6f510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1 2023-11-11 04:55:27,919 DEBUG [StoreOpener-9935958aa309b992cb5f336e4bc6f510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1 2023-11-11 04:55:27,919 INFO [StoreOpener-9935958aa309b992cb5f336e4bc6f510-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9935958aa309b992cb5f336e4bc6f510 columnFamilyName family1 2023-11-11 04:55:27,920 INFO [StoreOpener-9935958aa309b992cb5f336e4bc6f510-1] regionserver.HStore(310): Store=9935958aa309b992cb5f336e4bc6f510/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:27,920 INFO [StoreOpener-9935958aa309b992cb5f336e4bc6f510-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9935958aa309b992cb5f336e4bc6f510 2023-11-11 04:55:27,922 DEBUG [StoreOpener-9935958aa309b992cb5f336e4bc6f510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2 2023-11-11 04:55:27,922 DEBUG [StoreOpener-9935958aa309b992cb5f336e4bc6f510-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2 2023-11-11 04:55:27,922 INFO [StoreOpener-9935958aa309b992cb5f336e4bc6f510-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9935958aa309b992cb5f336e4bc6f510 columnFamilyName family2 2023-11-11 04:55:27,924 INFO [StoreOpener-9935958aa309b992cb5f336e4bc6f510-1] regionserver.HStore(310): Store=9935958aa309b992cb5f336e4bc6f510/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:27,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510 2023-11-11 04:55:27,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510 2023-11-11 04:55:27,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:27,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9935958aa309b992cb5f336e4bc6f510 2023-11-11 04:55:27,929 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/.tmp/family2/d2df70bab67445d9aa8f47cedbdf9851 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/d2df70bab67445d9aa8f47cedbdf9851 2023-11-11 04:55:27,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:55:27,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9935958aa309b992cb5f336e4bc6f510; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68184695, jitterRate=0.016031131148338318}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:27,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9935958aa309b992cb5f336e4bc6f510: 2023-11-11 04:55:27,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510., pid=110, masterSystemTime=1699678527913 2023-11-11 04:55:27,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:27,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:27,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:27,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d33048759c13f557d932f58e5b37d029, NAME => 'ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029.', STARTKEY => '', ENDKEY => '1'} 2023-11-11 04:55:27,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction d33048759c13f557d932f58e5b37d029 2023-11-11 04:55:27,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:27,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d33048759c13f557d932f58e5b37d029 2023-11-11 04:55:27,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d33048759c13f557d932f58e5b37d029 2023-11-11 04:55:27,933 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9935958aa309b992cb5f336e4bc6f510, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:27,934 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699678527933"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678527933"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678527933"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678527933"}]},"ts":"1699678527933"} 2023-11-11 04:55:27,935 INFO [StoreOpener-d33048759c13f557d932f58e5b37d029-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d33048759c13f557d932f58e5b37d029 2023-11-11 04:55:27,935 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in edd1396e4f13db5121a27e2b760689b0/family2 of edd1396e4f13db5121a27e2b760689b0 into d2df70bab67445d9aa8f47cedbdf9851(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:55:27,935 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:55:27,935 INFO [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0., storeName=edd1396e4f13db5121a27e2b760689b0/family2, priority=12, startTime=1699678525529; duration=0sec 2023-11-11 04:55:27,935 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-11 04:55:27,935 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-11 04:55:27,936 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-11 04:55:27,936 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-11 04:55:27,936 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. because compaction request was cancelled 2023-11-11 04:55:27,936 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-11 04:55:27,936 DEBUG [StoreOpener-d33048759c13f557d932f58e5b37d029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1 2023-11-11 04:55:27,936 DEBUG [StoreOpener-d33048759c13f557d932f58e5b37d029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1 2023-11-11 04:55:27,936 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-11 04:55:27,936 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-11 04:55:27,936 DEBUG [RS:0;jenkins-hbase4:43941-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. because compaction request was cancelled 2023-11-11 04:55:27,937 INFO [StoreOpener-d33048759c13f557d932f58e5b37d029-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d33048759c13f557d932f58e5b37d029 columnFamilyName family1 2023-11-11 04:55:27,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=107 2023-11-11 04:55:27,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 9935958aa309b992cb5f336e4bc6f510, server=jenkins-hbase4.apache.org,43941,1699678403879 in 173 msec 2023-11-11 04:55:27,937 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/.tmp/family2/20b23a01924a433ca9e93cc7d657bf09 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/20b23a01924a433ca9e93cc7d657bf09 2023-11-11 04:55:27,938 INFO [StoreOpener-d33048759c13f557d932f58e5b37d029-1] regionserver.HStore(310): Store=d33048759c13f557d932f58e5b37d029/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:27,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9935958aa309b992cb5f336e4bc6f510, ASSIGN in 332 msec 2023-11-11 04:55:27,938 INFO [StoreOpener-d33048759c13f557d932f58e5b37d029-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d33048759c13f557d932f58e5b37d029 2023-11-11 04:55:27,939 DEBUG [StoreOpener-d33048759c13f557d932f58e5b37d029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2 2023-11-11 04:55:27,939 DEBUG [StoreOpener-d33048759c13f557d932f58e5b37d029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2 2023-11-11 04:55:27,939 INFO [StoreOpener-d33048759c13f557d932f58e5b37d029-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d33048759c13f557d932f58e5b37d029 columnFamilyName family2 2023-11-11 04:55:27,940 INFO [StoreOpener-d33048759c13f557d932f58e5b37d029-1] regionserver.HStore(310): Store=d33048759c13f557d932f58e5b37d029/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:27,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029 2023-11-11 04:55:27,942 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 33b07a4e052e234a667f8fd20a21a8a8/family2 of 33b07a4e052e234a667f8fd20a21a8a8 into 20b23a01924a433ca9e93cc7d657bf09(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:55:27,942 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:55:27,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029 2023-11-11 04:55:27,942 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8., storeName=33b07a4e052e234a667f8fd20a21a8a8/family2, priority=12, startTime=1699678525454; duration=0sec 2023-11-11 04:55:27,942 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:55:27,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:27,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d33048759c13f557d932f58e5b37d029 2023-11-11 04:55:27,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:55:27,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d33048759c13f557d932f58e5b37d029; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62315910, jitterRate=-0.0714205801486969}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:27,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d33048759c13f557d932f58e5b37d029: 2023-11-11 04:55:27,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029., pid=111, masterSystemTime=1699678527913 2023-11-11 04:55:27,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:27,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:27,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:27,949 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d33048759c13f557d932f58e5b37d029, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:27,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d006bc838d3353e4d8b7fad62c39f9d, NAME => 'ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d.', STARTKEY => '2', ENDKEY => ''} 2023-11-11 04:55:27,949 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699678527948"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678527948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678527948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678527948"}]},"ts":"1699678527948"} 2023-11-11 04:55:27,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 4d006bc838d3353e4d8b7fad62c39f9d 2023-11-11 04:55:27,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:27,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4d006bc838d3353e4d8b7fad62c39f9d 2023-11-11 04:55:27,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4d006bc838d3353e4d8b7fad62c39f9d 2023-11-11 04:55:27,950 INFO [StoreOpener-4d006bc838d3353e4d8b7fad62c39f9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4d006bc838d3353e4d8b7fad62c39f9d 2023-11-11 04:55:27,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=106 2023-11-11 04:55:27,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure d33048759c13f557d932f58e5b37d029, server=jenkins-hbase4.apache.org,43941,1699678403879 in 187 msec 2023-11-11 04:55:27,951 DEBUG [StoreOpener-4d006bc838d3353e4d8b7fad62c39f9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1 2023-11-11 04:55:27,951 DEBUG [StoreOpener-4d006bc838d3353e4d8b7fad62c39f9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1 2023-11-11 04:55:27,952 INFO [StoreOpener-4d006bc838d3353e4d8b7fad62c39f9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d006bc838d3353e4d8b7fad62c39f9d columnFamilyName family1 2023-11-11 04:55:27,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d33048759c13f557d932f58e5b37d029, ASSIGN in 346 msec 2023-11-11 04:55:27,952 INFO [StoreOpener-4d006bc838d3353e4d8b7fad62c39f9d-1] regionserver.HStore(310): Store=4d006bc838d3353e4d8b7fad62c39f9d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:27,952 INFO [StoreOpener-4d006bc838d3353e4d8b7fad62c39f9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4d006bc838d3353e4d8b7fad62c39f9d 2023-11-11 04:55:27,953 DEBUG [StoreOpener-4d006bc838d3353e4d8b7fad62c39f9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2 2023-11-11 04:55:27,954 DEBUG [StoreOpener-4d006bc838d3353e4d8b7fad62c39f9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2 2023-11-11 04:55:27,954 INFO [StoreOpener-4d006bc838d3353e4d8b7fad62c39f9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d006bc838d3353e4d8b7fad62c39f9d columnFamilyName family2 2023-11-11 04:55:27,954 INFO [StoreOpener-4d006bc838d3353e4d8b7fad62c39f9d-1] regionserver.HStore(310): Store=4d006bc838d3353e4d8b7fad62c39f9d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:27,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d 2023-11-11 04:55:27,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d 2023-11-11 04:55:27,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:27,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4d006bc838d3353e4d8b7fad62c39f9d 2023-11-11 04:55:27,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:55:27,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4d006bc838d3353e4d8b7fad62c39f9d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59991931, jitterRate=-0.10605056583881378}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:27,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4d006bc838d3353e4d8b7fad62c39f9d: 2023-11-11 04:55:27,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d., pid=109, masterSystemTime=1699678527913 2023-11-11 04:55:27,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:27,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:27,961 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=4d006bc838d3353e4d8b7fad62c39f9d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:27,961 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699678527961"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678527961"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678527961"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678527961"}]},"ts":"1699678527961"} 2023-11-11 04:55:27,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=108 2023-11-11 04:55:27,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 4d006bc838d3353e4d8b7fad62c39f9d, server=jenkins-hbase4.apache.org,43941,1699678403879 in 200 msec 2023-11-11 04:55:27,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=105 2023-11-11 04:55:27,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4d006bc838d3353e4d8b7fad62c39f9d, ASSIGN in 357 msec 2023-11-11 04:55:27,965 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:55:27,965 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678527965"}]},"ts":"1699678527965"} 2023-11-11 04:55:27,966 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-11 04:55:27,968 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:55:27,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2060 sec 2023-11-11 04:55:27,998 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-b99159def6524322a8bb631204eb429f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-ad560bd65d1d41a9b263affab1c67608, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-71cef7d3bb9d45d0982a108ae89701b9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-4d7faf7097e046b88674840e9692e390] to archive 2023-11-11 04:55:27,998 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:28,000 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-b99159def6524322a8bb631204eb429f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-b99159def6524322a8bb631204eb429f 2023-11-11 04:55:28,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-ad560bd65d1d41a9b263affab1c67608 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-ad560bd65d1d41a9b263affab1c67608 2023-11-11 04:55:28,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-71cef7d3bb9d45d0982a108ae89701b9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-71cef7d3bb9d45d0982a108ae89701b9 2023-11-11 04:55:28,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-4d7faf7097e046b88674840e9692e390 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/family2/testCompactionWithHFileLink=edd1396e4f13db5121a27e2b760689b0-4d7faf7097e046b88674840e9692e390 2023-11-11 04:55:28,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-0c94b698495645a380e12a9e6c768bea, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-64f9c35100864faf98ee944976b8d698, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-a389ca6175d748b3a8f28aa471b4f54d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf5f9e8ac56540e981b58e11f0cfd06e] to archive 2023-11-11 04:55:28,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:28,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-0c94b698495645a380e12a9e6c768bea to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-0c94b698495645a380e12a9e6c768bea 2023-11-11 04:55:28,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-64f9c35100864faf98ee944976b8d698 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-64f9c35100864faf98ee944976b8d698 2023-11-11 04:55:28,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-a389ca6175d748b3a8f28aa471b4f54d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-a389ca6175d748b3a8f28aa471b4f54d 2023-11-11 04:55:28,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf5f9e8ac56540e981b58e11f0cfd06e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/family2/testCompactionWithHFileLink=33b07a4e052e234a667f8fd20a21a8a8-bf5f9e8ac56540e981b58e11f0cfd06e 2023-11-11 04:55:28,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 04:55:28,871 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-11 04:55:28,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:28,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:28,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:28,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:28,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-11 04:55:28,881 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-11 04:55:28,881 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:28,881 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-11 04:55:28,881 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-11 04:55:28,881 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:28,881 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:28,882 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:28,883 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:28,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:28,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:28,883 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:28,883 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:28,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:28,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:28,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:28,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:28,884 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-11 04:55:28,884 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-11 04:55:28,884 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-11 04:55:28,884 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:28,884 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-11 04:55:28,884 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:28,884 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. started... 2023-11-11 04:55:28,886 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9935958aa309b992cb5f336e4bc6f510 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 04:55:28,886 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:28,886 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. started... 2023-11-11 04:55:28,887 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d33048759c13f557d932f58e5b37d029 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 04:55:28,887 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:28,887 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:28,887 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:28,887 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. started... 2023-11-11 04:55:28,887 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4d006bc838d3353e4d8b7fad62c39f9d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 04:55:28,903 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111a46c181f623f4880a7646c24ec953bd1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111a46c181f623f4880a7646c24ec953bd1 2023-11-11 04:55:29,302 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311116d28645d991347db89271ed4c5dd42b2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311116d28645d991347db89271ed4c5dd42b2 2023-11-11 04:55:29,302 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311115902b592630841108c03a80df59f09bd to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311115902b592630841108c03a80df59f09bd 2023-11-11 04:55:29,307 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family1/b4d7f768de444e69ba89afa150455f47 2023-11-11 04:55:29,707 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family1/269eb3bd5df648b68d801116063083ba 2023-11-11 04:55:29,707 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family1/624beaf2c4924468ab59ff0f413dbc32 2023-11-11 04:55:29,720 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111aa976b9a767841ff9e84feb7f78227a1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231111aa976b9a767841ff9e84feb7f78227a1 2023-11-11 04:55:29,721 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111b66d01e223ac4dcc844d18888c89ff83 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231111b66d01e223ac4dcc844d18888c89ff83 2023-11-11 04:55:29,722 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111120841910dd7f4f789c38acb9b5476e34 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023111120841910dd7f4f789c38acb9b5476e34 2023-11-11 04:55:29,733 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family2/c4313ccaca694e15a804dc9d0b9f34b2 2023-11-11 04:55:29,737 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family1/624beaf2c4924468ab59ff0f413dbc32 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/624beaf2c4924468ab59ff0f413dbc32 2023-11-11 04:55:29,740 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/624beaf2c4924468ab59ff0f413dbc32, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 04:55:29,740 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family2/c4313ccaca694e15a804dc9d0b9f34b2 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/c4313ccaca694e15a804dc9d0b9f34b2 2023-11-11 04:55:29,744 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/c4313ccaca694e15a804dc9d0b9f34b2, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 04:55:29,744 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4d006bc838d3353e4d8b7fad62c39f9d in 857ms, sequenceid=5, compaction requested=false 2023-11-11 04:55:29,744 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-11 04:55:29,745 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4d006bc838d3353e4d8b7fad62c39f9d: 2023-11-11 04:55:29,745 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:29,745 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:30,127 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family2/068ccbbcb871402da31d2953d60b1a93 2023-11-11 04:55:30,131 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family1/b4d7f768de444e69ba89afa150455f47 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/b4d7f768de444e69ba89afa150455f47 2023-11-11 04:55:30,132 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family2/04bf4f8d26d14f26896e0ae049782e13 2023-11-11 04:55:30,135 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/b4d7f768de444e69ba89afa150455f47, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 04:55:30,136 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family2/068ccbbcb871402da31d2953d60b1a93 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/068ccbbcb871402da31d2953d60b1a93 2023-11-11 04:55:30,136 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family1/269eb3bd5df648b68d801116063083ba as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/269eb3bd5df648b68d801116063083ba 2023-11-11 04:55:30,139 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/068ccbbcb871402da31d2953d60b1a93, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 04:55:30,140 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/269eb3bd5df648b68d801116063083ba, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 04:55:30,140 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d33048759c13f557d932f58e5b37d029 in 1253ms, sequenceid=5, compaction requested=false 2023-11-11 04:55:30,141 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d33048759c13f557d932f58e5b37d029: 2023-11-11 04:55:30,141 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:30,141 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:30,142 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family2/04bf4f8d26d14f26896e0ae049782e13 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/04bf4f8d26d14f26896e0ae049782e13 2023-11-11 04:55:30,145 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/04bf4f8d26d14f26896e0ae049782e13, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 04:55:30,146 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9935958aa309b992cb5f336e4bc6f510 in 1260ms, sequenceid=5, compaction requested=false 2023-11-11 04:55:30,146 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9935958aa309b992cb5f336e4bc6f510: 2023-11-11 04:55:30,146 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:30,146 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:30,146 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:30,146 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,146 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-11 04:55:30,146 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-11 04:55:30,148 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:30,148 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:30,148 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:30,148 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:30,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-11 04:55:30,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f2ccbda[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:30,150 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-11 04:55:30,150 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:30,151 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:30,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:30,151 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-11 04:55:30,151 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-11 04:55:30,151 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:30,151 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,151 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:30,153 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,153 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-11 04:55:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:30,153 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:30,153 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-11 04:55:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:30,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:30,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:30,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:30,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-11 04:55:30,155 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-11 04:55:30,155 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:30,155 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:30,155 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-11 04:55:30,155 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:30,157 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:30,158 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:30,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:30,158 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:30,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:30,158 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,160 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,162 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:30,162 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:30,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:30,162 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-11 04:55:30,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:30,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:30,162 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:30,162 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:30,162 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:30,162 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,162 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:30,162 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:30,163 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:30,163 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:30,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:30,163 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:30,263 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:30,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:30,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:30,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:30,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:30,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:30,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:30,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-11 04:55:30,269 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-11 04:55:30,269 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:30,269 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-11 04:55:30,269 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-11 04:55:30,269 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:30,269 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:30,271 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,271 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:30,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:30,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:30,271 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:30,271 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:30,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:30,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:30,272 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-11 04:55:30,272 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-11 04:55:30,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-11 04:55:30,272 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-11 04:55:30,272 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:30,272 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-11 04:55:30,272 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:30,272 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. started... 2023-11-11 04:55:30,272 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:30,272 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:30,273 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9935958aa309b992cb5f336e4bc6f510 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 04:55:30,273 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:30,273 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:30,273 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. started... 2023-11-11 04:55:30,273 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. started... 2023-11-11 04:55:30,273 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d33048759c13f557d932f58e5b37d029 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 04:55:30,273 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4d006bc838d3353e4d8b7fad62c39f9d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 04:55:30,688 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111c221db5b1f254cedaa297c1e1bb8a93c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111c221db5b1f254cedaa297c1e1bb8a93c 2023-11-11 04:55:30,689 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111256d150ed6ca400187d163bfc97fbf2a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231111256d150ed6ca400187d163bfc97fbf2a 2023-11-11 04:55:30,689 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311114c15589f515f43a4adff96161592235d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311114c15589f515f43a4adff96161592235d 2023-11-11 04:55:31,095 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family1/a1d52bdbf25c42e6bd7acb7bbd101d01 2023-11-11 04:55:31,095 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family1/6a8de13980334ccc9dd69a3161763e4b 2023-11-11 04:55:31,095 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family1/cbe7194098654f55a902ae019571d38e 2023-11-11 04:55:31,108 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111eeb1e2d6d5cd46f4af9776c9fc5df3dc to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231111eeb1e2d6d5cd46f4af9776c9fc5df3dc 2023-11-11 04:55:31,509 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111193f4b9b196a04cedaeb3390d9b017854 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023111193f4b9b196a04cedaeb3390d9b017854 2023-11-11 04:55:31,509 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111115f1f0c304094622ad6ee618002fc67e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023111115f1f0c304094622ad6ee618002fc67e 2023-11-11 04:55:31,513 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family2/51b6ea80ef1f49dabe00f7cb63bba37d 2023-11-11 04:55:31,514 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family2/6fd9c910128d485bb6d7a215988392e3 2023-11-11 04:55:31,518 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family1/cbe7194098654f55a902ae019571d38e as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/cbe7194098654f55a902ae019571d38e 2023-11-11 04:55:31,519 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family1/a1d52bdbf25c42e6bd7acb7bbd101d01 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/a1d52bdbf25c42e6bd7acb7bbd101d01 2023-11-11 04:55:31,521 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/cbe7194098654f55a902ae019571d38e, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 04:55:31,522 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family2/51b6ea80ef1f49dabe00f7cb63bba37d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/51b6ea80ef1f49dabe00f7cb63bba37d 2023-11-11 04:55:31,522 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/a1d52bdbf25c42e6bd7acb7bbd101d01, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 04:55:31,523 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family2/6fd9c910128d485bb6d7a215988392e3 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6fd9c910128d485bb6d7a215988392e3 2023-11-11 04:55:31,526 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/51b6ea80ef1f49dabe00f7cb63bba37d, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 04:55:31,526 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6fd9c910128d485bb6d7a215988392e3, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 04:55:31,527 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4d006bc838d3353e4d8b7fad62c39f9d in 1254ms, sequenceid=9, compaction requested=false 2023-11-11 04:55:31,527 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9935958aa309b992cb5f336e4bc6f510 in 1254ms, sequenceid=9, compaction requested=false 2023-11-11 04:55:31,527 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4d006bc838d3353e4d8b7fad62c39f9d: 2023-11-11 04:55:31,527 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9935958aa309b992cb5f336e4bc6f510: 2023-11-11 04:55:31,527 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:31,527 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:31,527 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:31,527 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:31,915 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family2/2bc5ae4a366d451a9f2bb45ec340e82f 2023-11-11 04:55:31,919 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family1/6a8de13980334ccc9dd69a3161763e4b as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/6a8de13980334ccc9dd69a3161763e4b 2023-11-11 04:55:31,922 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/6a8de13980334ccc9dd69a3161763e4b, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 04:55:31,923 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family2/2bc5ae4a366d451a9f2bb45ec340e82f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/2bc5ae4a366d451a9f2bb45ec340e82f 2023-11-11 04:55:31,940 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:55:31,940 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5feecb60 to 127.0.0.1:61842 2023-11-11 04:55:31,940 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:31,941 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:55:31,941 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27aeca0b to 127.0.0.1:61842 2023-11-11 04:55:31,941 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:31,941 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:55:31,941 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e834060 to 127.0.0.1:61842 2023-11-11 04:55:31,941 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:55:31,944 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/2bc5ae4a366d451a9f2bb45ec340e82f, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 04:55:31,945 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d33048759c13f557d932f58e5b37d029 in 1672ms, sequenceid=9, compaction requested=false 2023-11-11 04:55:31,945 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d33048759c13f557d932f58e5b37d029: 2023-11-11 04:55:31,945 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:31,945 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:31,945 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:31,945 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,945 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-11 04:55:31,945 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-11 04:55:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:31,948 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:31,949 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:31,949 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:31,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:31,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-11 04:55:31,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bef15db[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:31,950 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-11 04:55:31,950 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:31,951 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:31,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:31,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:31,952 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-11 04:55:31,952 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-11 04:55:31,952 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:31,952 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,952 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:31,954 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-11 04:55:31,954 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,954 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:31,954 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-11 04:55:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:31,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:31,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:31,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-11 04:55:31,957 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-11 04:55:31,957 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:31,957 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:31,957 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-11 04:55:31,957 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:31,959 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:31,959 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:31,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:31,959 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:31,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:31,959 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:31,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:31,961 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:31,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:31,963 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:31,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-11 04:55:31,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:31,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-11 04:55:31,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:31,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:31,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:31,964 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:31,963 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:31,964 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:31,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:31,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:31,964 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:31,964 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:31,964 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:32,064 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:32,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:32,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:32,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:32,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:32,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:32,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:32,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-11 04:55:32,070 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-11 04:55:32,070 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:32,070 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-11 04:55:32,070 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-11 04:55:32,070 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:32,070 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:32,072 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:32,072 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:32,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:32,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:32,072 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:32,072 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:32,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:32,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:32,073 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-11 04:55:32,073 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-11 04:55:32,074 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-11 04:55:32,074 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-11 04:55:32,074 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:32,074 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-11 04:55:32,074 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:32,074 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. started... 2023-11-11 04:55:32,074 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9935958aa309b992cb5f336e4bc6f510 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 04:55:32,077 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:32,077 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. started... 2023-11-11 04:55:32,077 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d33048759c13f557d932f58e5b37d029 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 04:55:32,079 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:32,079 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:32,079 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:32,079 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. started... 2023-11-11 04:55:32,079 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4d006bc838d3353e4d8b7fad62c39f9d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 04:55:32,498 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311118ca095417445475ab30ec381015cceec to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311118ca095417445475ab30ec381015cceec 2023-11-11 04:55:32,499 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311118549388429b146498c5d0b933c2a5bd7 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311118549388429b146498c5d0b933c2a5bd7 2023-11-11 04:55:32,499 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111da2947b51e33416d962ed4fd435a1b98 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231111da2947b51e33416d962ed4fd435a1b98 2023-11-11 04:55:32,514 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family1/720e0ea8afc04ce6b5347af4b53b2925 2023-11-11 04:55:32,911 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family1/16072904666147e68db65e61fad00bb8 2023-11-11 04:55:32,912 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family1/5a4bb3c9d33845e5a60a59717654cf4f 2023-11-11 04:55:32,925 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111195b5e45e424e489d97d8e59881364df1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023111195b5e45e424e489d97d8e59881364df1 2023-11-11 04:55:32,929 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family2/09180e577bfe421690628196b998473d 2023-11-11 04:55:32,929 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111621b4c0437cf48618d8b858e4965aee5 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231111621b4c0437cf48618d8b858e4965aee5 2023-11-11 04:55:32,932 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family1/5a4bb3c9d33845e5a60a59717654cf4f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/5a4bb3c9d33845e5a60a59717654cf4f 2023-11-11 04:55:32,934 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family2/86b2283cde7b43239c332fee20867a24 2023-11-11 04:55:32,936 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/5a4bb3c9d33845e5a60a59717654cf4f, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 04:55:32,937 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family2/09180e577bfe421690628196b998473d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/09180e577bfe421690628196b998473d 2023-11-11 04:55:32,937 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family1/720e0ea8afc04ce6b5347af4b53b2925 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/720e0ea8afc04ce6b5347af4b53b2925 2023-11-11 04:55:32,941 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/09180e577bfe421690628196b998473d, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 04:55:32,941 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/720e0ea8afc04ce6b5347af4b53b2925, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 04:55:32,941 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4d006bc838d3353e4d8b7fad62c39f9d in 862ms, sequenceid=13, compaction requested=true 2023-11-11 04:55:32,941 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family2/86b2283cde7b43239c332fee20867a24 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/86b2283cde7b43239c332fee20867a24 2023-11-11 04:55:32,942 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4d006bc838d3353e4d8b7fad62c39f9d: 2023-11-11 04:55:32,942 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:32,942 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:32,945 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/86b2283cde7b43239c332fee20867a24, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 04:55:32,945 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d33048759c13f557d932f58e5b37d029 in 868ms, sequenceid=13, compaction requested=true 2023-11-11 04:55:32,945 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d33048759c13f557d932f58e5b37d029: 2023-11-11 04:55:32,946 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:32,946 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:33,326 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311113a497ef208d64272874dab6c929a958b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311113a497ef208d64272874dab6c929a958b 2023-11-11 04:55:33,418 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:55:33,730 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family2/7f4195e9639748e0a67253a11fce9a9f 2023-11-11 04:55:33,734 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family1/16072904666147e68db65e61fad00bb8 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/16072904666147e68db65e61fad00bb8 2023-11-11 04:55:33,738 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/16072904666147e68db65e61fad00bb8, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 04:55:33,738 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family2/7f4195e9639748e0a67253a11fce9a9f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7f4195e9639748e0a67253a11fce9a9f 2023-11-11 04:55:33,742 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7f4195e9639748e0a67253a11fce9a9f, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 04:55:33,743 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9935958aa309b992cb5f336e4bc6f510 in 1669ms, sequenceid=13, compaction requested=true 2023-11-11 04:55:33,743 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9935958aa309b992cb5f336e4bc6f510: 2023-11-11 04:55:33,743 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:33,743 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:33,743 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:33,743 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,743 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-11 04:55:33,743 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-11 04:55:33,746 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:33,746 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:33,746 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:33,746 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:33,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-11 04:55:33,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@694074cc[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:33,747 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-11 04:55:33,747 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:33,749 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:33,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:33,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:33,749 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-11 04:55:33,749 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-11 04:55:33,749 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:33,749 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,749 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:33,750 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-11 04:55:33,750 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:33,750 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,750 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-11 04:55:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:33,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-11 04:55:33,752 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-11 04:55:33,752 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:33,753 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:33,753 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-11 04:55:33,753 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:33,760 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:33,760 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:33,760 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:33,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:33,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:33,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:33,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:33,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:33,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:33,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:33,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:33,761 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:33,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,762 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:33,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:33,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,765 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,765 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:33,765 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:33,765 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:33,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:33,765 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:33,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-11 04:55:33,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:33,765 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,765 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:33,765 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:33,765 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:33,765 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:33,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:33,765 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:33,765 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:33,865 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:33,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:33,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:33,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:33,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:33,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:33,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:33,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-11 04:55:33,872 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-11 04:55:33,872 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:33,872 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-11 04:55:33,872 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-11 04:55:33,872 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:33,872 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:33,874 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,874 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:33,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:33,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:33,874 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:33,874 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:33,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:33,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:33,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:33,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:33,875 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-11 04:55:33,875 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-11 04:55:33,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-11 04:55:33,875 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-11 04:55:33,875 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:33,875 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-11 04:55:33,875 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:33,876 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. started... 2023-11-11 04:55:33,876 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:33,876 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. started... 2023-11-11 04:55:33,876 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9935958aa309b992cb5f336e4bc6f510 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 04:55:33,876 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d33048759c13f557d932f58e5b37d029 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 04:55:33,876 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:33,876 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:33,876 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:33,876 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. started... 2023-11-11 04:55:33,877 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4d006bc838d3353e4d8b7fad62c39f9d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 04:55:33,891 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311119e4d4814bf65448bb0f17900a4dbeca9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311119e4d4814bf65448bb0f17900a4dbeca9 2023-11-11 04:55:33,891 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311118a57f16e645546eb921d842395df063b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311118a57f16e645546eb921d842395df063b 2023-11-11 04:55:33,894 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111fe2dd682c4064aeaa1fc757a6b1d90e3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111fe2dd682c4064aeaa1fc757a6b1d90e3 2023-11-11 04:55:33,897 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family1/d870e2620f514d7f9aef09e9e4800d98 2023-11-11 04:55:33,898 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family1/2855eab266644af19e50390c8ca738c5 2023-11-11 04:55:33,899 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family1/c12ffffa86554b96a4af4ad2343bc214 2023-11-11 04:55:33,910 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111d7279836b7974a17aba04f6c46d476db to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231111d7279836b7974a17aba04f6c46d476db 2023-11-11 04:55:33,911 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111155909bc2e6b54db5b40b854bd737ae42 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023111155909bc2e6b54db5b40b854bd737ae42 2023-11-11 04:55:33,912 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111e4f357af746945e4af2fae012ff561b2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231111e4f357af746945e4af2fae012ff561b2 2023-11-11 04:55:33,918 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family2/ad0000b6f20344068aef0463bf027b9f 2023-11-11 04:55:33,921 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family1/c12ffffa86554b96a4af4ad2343bc214 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/c12ffffa86554b96a4af4ad2343bc214 2023-11-11 04:55:33,924 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/c12ffffa86554b96a4af4ad2343bc214, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 04:55:33,925 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family2/ad0000b6f20344068aef0463bf027b9f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/ad0000b6f20344068aef0463bf027b9f 2023-11-11 04:55:33,928 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/ad0000b6f20344068aef0463bf027b9f, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 04:55:33,928 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d33048759c13f557d932f58e5b37d029 in 52ms, sequenceid=17, compaction requested=true 2023-11-11 04:55:33,928 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d33048759c13f557d932f58e5b37d029: 2023-11-11 04:55:33,928 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:33,928 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:34,315 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family2/7cd1d5dc896348aa9845963baa1665d9 2023-11-11 04:55:34,316 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family2/9703f5d70ac34befaf08601acb316489 2023-11-11 04:55:34,319 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family1/2855eab266644af19e50390c8ca738c5 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/2855eab266644af19e50390c8ca738c5 2023-11-11 04:55:34,320 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family1/d870e2620f514d7f9aef09e9e4800d98 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/d870e2620f514d7f9aef09e9e4800d98 2023-11-11 04:55:34,323 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/2855eab266644af19e50390c8ca738c5, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 04:55:34,323 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/d870e2620f514d7f9aef09e9e4800d98, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 04:55:34,324 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family2/9703f5d70ac34befaf08601acb316489 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/9703f5d70ac34befaf08601acb316489 2023-11-11 04:55:34,324 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family2/7cd1d5dc896348aa9845963baa1665d9 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7cd1d5dc896348aa9845963baa1665d9 2023-11-11 04:55:34,327 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/9703f5d70ac34befaf08601acb316489, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 04:55:34,328 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7cd1d5dc896348aa9845963baa1665d9, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 04:55:34,328 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4d006bc838d3353e4d8b7fad62c39f9d in 451ms, sequenceid=17, compaction requested=true 2023-11-11 04:55:34,328 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4d006bc838d3353e4d8b7fad62c39f9d: 2023-11-11 04:55:34,328 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:34,328 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:34,328 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9935958aa309b992cb5f336e4bc6f510 in 452ms, sequenceid=17, compaction requested=true 2023-11-11 04:55:34,328 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9935958aa309b992cb5f336e4bc6f510: 2023-11-11 04:55:34,329 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:34,329 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:34,329 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:34,329 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,329 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-11 04:55:34,329 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-11 04:55:34,330 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,330 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:34,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:34,331 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:34,331 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:34,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-11 04:55:34,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3de2a71f[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:34,332 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-11 04:55:34,332 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:34,333 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:34,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:34,333 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-11 04:55:34,333 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-11 04:55:34,333 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:34,334 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,334 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:34,335 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-11 04:55:34,335 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:34,335 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,335 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-11 04:55:34,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:34,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:34,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:34,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-11 04:55:34,337 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-11 04:55:34,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:34,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:34,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-11 04:55:34,337 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:34,340 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:34,340 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:34,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:34,340 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:34,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:34,340 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,342 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,344 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,344 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:34,344 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:34,344 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:34,344 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:34,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:34,344 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:34,344 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:34,344 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:34,344 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:34,344 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:34,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-11 04:55:34,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:34,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:34,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:34,345 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:34,345 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:34,445 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:34,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:34,453 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:34,459 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:34,466 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:34,466 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:34,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:34,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:34,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-11 04:55:34,492 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-11 04:55:34,492 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:34,492 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-11 04:55:34,492 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-11 04:55:34,493 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:34,493 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:34,494 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,494 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:34,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:34,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:34,494 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:34,494 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:34,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:34,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:34,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:34,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:34,495 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-11 04:55:34,496 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-11 04:55:34,496 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-11 04:55:34,496 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-11 04:55:34,496 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:34,496 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-11 04:55:34,496 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:34,496 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. started... 2023-11-11 04:55:34,496 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:34,496 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:34,496 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9935958aa309b992cb5f336e4bc6f510 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 04:55:34,496 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:34,496 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. started... 2023-11-11 04:55:34,496 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:34,496 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4d006bc838d3353e4d8b7fad62c39f9d 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 04:55:34,496 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. started... 2023-11-11 04:55:34,496 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d33048759c13f557d932f58e5b37d029 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 04:55:34,515 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family1/bf2a071d84ff431dabf2614950b8fbcb 2023-11-11 04:55:34,518 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family1/48af898f9d9748cc9e34993b4cf0fb3e 2023-11-11 04:55:34,519 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf2a071d84ff431dabf2614950b8fbcb 2023-11-11 04:55:34,521 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48af898f9d9748cc9e34993b4cf0fb3e 2023-11-11 04:55:34,534 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family2/2ebdaec7ed9f46148b1d31078dab9680 2023-11-11 04:55:34,537 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ebdaec7ed9f46148b1d31078dab9680 2023-11-11 04:55:34,538 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family1/48af898f9d9748cc9e34993b4cf0fb3e as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/48af898f9d9748cc9e34993b4cf0fb3e 2023-11-11 04:55:34,541 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48af898f9d9748cc9e34993b4cf0fb3e 2023-11-11 04:55:34,541 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/48af898f9d9748cc9e34993b4cf0fb3e, entries=3, sequenceid=23, filesize=5.0 K 2023-11-11 04:55:34,542 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family2/2ebdaec7ed9f46148b1d31078dab9680 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/2ebdaec7ed9f46148b1d31078dab9680 2023-11-11 04:55:34,545 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ebdaec7ed9f46148b1d31078dab9680 2023-11-11 04:55:34,545 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/2ebdaec7ed9f46148b1d31078dab9680, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 04:55:34,546 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4d006bc838d3353e4d8b7fad62c39f9d in 50ms, sequenceid=23, compaction requested=true 2023-11-11 04:55:34,546 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4d006bc838d3353e4d8b7fad62c39f9d: 2023-11-11 04:55:34,546 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:34,546 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:35,310 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family1/2d11ffcdce93498a91bc4050e7f5bcea 2023-11-11 04:55:35,315 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d11ffcdce93498a91bc4050e7f5bcea 2023-11-11 04:55:35,330 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family2/eee92cb9e3784c80b14c9775ef824fc7 2023-11-11 04:55:35,333 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eee92cb9e3784c80b14c9775ef824fc7 2023-11-11 04:55:35,333 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family1/bf2a071d84ff431dabf2614950b8fbcb as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/bf2a071d84ff431dabf2614950b8fbcb 2023-11-11 04:55:35,337 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf2a071d84ff431dabf2614950b8fbcb 2023-11-11 04:55:35,337 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/bf2a071d84ff431dabf2614950b8fbcb, entries=3, sequenceid=23, filesize=5.0 K 2023-11-11 04:55:35,337 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family2/eee92cb9e3784c80b14c9775ef824fc7 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/eee92cb9e3784c80b14c9775ef824fc7 2023-11-11 04:55:35,341 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eee92cb9e3784c80b14c9775ef824fc7 2023-11-11 04:55:35,341 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/eee92cb9e3784c80b14c9775ef824fc7, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 04:55:35,341 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d33048759c13f557d932f58e5b37d029 in 845ms, sequenceid=23, compaction requested=true 2023-11-11 04:55:35,341 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d33048759c13f557d932f58e5b37d029: 2023-11-11 04:55:35,341 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:35,341 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:36,127 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family2/6f0b8a67abb449868cbbe5fb0cfa2848 2023-11-11 04:55:36,131 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f0b8a67abb449868cbbe5fb0cfa2848 2023-11-11 04:55:36,131 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family1/2d11ffcdce93498a91bc4050e7f5bcea as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/2d11ffcdce93498a91bc4050e7f5bcea 2023-11-11 04:55:36,134 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d11ffcdce93498a91bc4050e7f5bcea 2023-11-11 04:55:36,135 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/2d11ffcdce93498a91bc4050e7f5bcea, entries=3, sequenceid=23, filesize=5.0 K 2023-11-11 04:55:36,135 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family2/6f0b8a67abb449868cbbe5fb0cfa2848 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6f0b8a67abb449868cbbe5fb0cfa2848 2023-11-11 04:55:36,139 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f0b8a67abb449868cbbe5fb0cfa2848 2023-11-11 04:55:36,139 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6f0b8a67abb449868cbbe5fb0cfa2848, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 04:55:36,139 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9935958aa309b992cb5f336e4bc6f510 in 1643ms, sequenceid=23, compaction requested=true 2023-11-11 04:55:36,139 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9935958aa309b992cb5f336e4bc6f510: 2023-11-11 04:55:36,139 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:36,139 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:36,140 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:36,140 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,140 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-11 04:55:36,140 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-11 04:55:36,141 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,141 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:36,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:36,142 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:36,142 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:36,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:36,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-11 04:55:36,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74d9c962[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:36,143 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-11 04:55:36,143 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:36,145 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:36,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:36,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:36,145 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-11 04:55:36,145 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-11 04:55:36,145 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:36,145 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,146 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:36,147 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,147 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-11 04:55:36,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:36,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:36,147 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:36,147 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-11 04:55:36,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:36,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:36,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:36,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:36,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:36,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:36,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-11 04:55:36,149 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-11 04:55:36,149 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:36,149 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:36,149 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-11 04:55:36,149 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:36,151 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:36,151 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:36,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:36,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:36,151 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:36,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:36,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:36,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:36,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:36,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:36,152 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:36,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:36,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:36,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:36,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:36,153 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:36,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 04:55:36,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,155 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,155 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:36,155 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 04:55:36,155 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:36,155 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:36,155 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:36,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:36,155 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 04:55:36,155 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 04:55:36,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-11 04:55:36,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-11 04:55:36,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:36,155 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:36,155 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:36,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:36,156 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:36,156 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:36,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:36,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:36,256 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:36,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:36,257 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:36,257 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 9935958aa309b992cb5f336e4bc6f510/family1 is initiating major compaction (all files) 2023-11-11 04:55:36,257 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:36,257 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:36,257 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 9935958aa309b992cb5f336e4bc6f510/family1 in ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:36,257 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/269eb3bd5df648b68d801116063083ba, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/a1d52bdbf25c42e6bd7acb7bbd101d01, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/16072904666147e68db65e61fad00bb8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/d870e2620f514d7f9aef09e9e4800d98, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/2d11ffcdce93498a91bc4050e7f5bcea] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp, totalSize=26.6 K 2023-11-11 04:55:36,258 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 269eb3bd5df648b68d801116063083ba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678528877 2023-11-11 04:55:36,258 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting a1d52bdbf25c42e6bd7acb7bbd101d01, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678530265 2023-11-11 04:55:36,259 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 16072904666147e68db65e61fad00bb8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678532066 2023-11-11 04:55:36,259 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting d870e2620f514d7f9aef09e9e4800d98, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678533868 2023-11-11 04:55:36,259 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 2d11ffcdce93498a91bc4050e7f5bcea, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:55:36,270 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 9935958aa309b992cb5f336e4bc6f510#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:36,679 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231111030b04841c384686a5ac3f35e53cd795_del 2023-11-11 04:55:36,679 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111030b04841c384686a5ac3f35e53cd795_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231111030b04841c384686a5ac3f35e53cd795_del 2023-11-11 04:55:37,492 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d54b63caece4508b81bca9b21f03de7 2023-11-11 04:55:37,493 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family1/2d54b63caece4508b81bca9b21f03de7 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/2d54b63caece4508b81bca9b21f03de7 2023-11-11 04:55:37,496 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d54b63caece4508b81bca9b21f03de7 2023-11-11 04:55:37,497 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9935958aa309b992cb5f336e4bc6f510/family1 of 9935958aa309b992cb5f336e4bc6f510 into 2d54b63caece4508b81bca9b21f03de7(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:55:37,497 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 9935958aa309b992cb5f336e4bc6f510: 2023-11-11 04:55:37,497 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:37,497 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 9935958aa309b992cb5f336e4bc6f510/family2 is initiating major compaction (all files) 2023-11-11 04:55:37,497 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:37,497 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:37,497 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 9935958aa309b992cb5f336e4bc6f510/family2 in ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:55:37,497 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/04bf4f8d26d14f26896e0ae049782e13, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6fd9c910128d485bb6d7a215988392e3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7f4195e9639748e0a67253a11fce9a9f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7cd1d5dc896348aa9845963baa1665d9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6f0b8a67abb449868cbbe5fb0cfa2848] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp, totalSize=25.3 K 2023-11-11 04:55:37,498 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 04bf4f8d26d14f26896e0ae049782e13, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678528877 2023-11-11 04:55:37,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/269eb3bd5df648b68d801116063083ba, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/a1d52bdbf25c42e6bd7acb7bbd101d01, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/16072904666147e68db65e61fad00bb8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/d870e2620f514d7f9aef09e9e4800d98, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/2d11ffcdce93498a91bc4050e7f5bcea] to archive 2023-11-11 04:55:37,498 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 6fd9c910128d485bb6d7a215988392e3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678530265 2023-11-11 04:55:37,498 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 7f4195e9639748e0a67253a11fce9a9f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678532066 2023-11-11 04:55:37,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:37,499 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 7cd1d5dc896348aa9845963baa1665d9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678533868 2023-11-11 04:55:37,499 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 6f0b8a67abb449868cbbe5fb0cfa2848, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:55:37,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/269eb3bd5df648b68d801116063083ba to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/269eb3bd5df648b68d801116063083ba 2023-11-11 04:55:37,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/a1d52bdbf25c42e6bd7acb7bbd101d01 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/a1d52bdbf25c42e6bd7acb7bbd101d01 2023-11-11 04:55:37,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/16072904666147e68db65e61fad00bb8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/16072904666147e68db65e61fad00bb8 2023-11-11 04:55:37,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/d870e2620f514d7f9aef09e9e4800d98 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/d870e2620f514d7f9aef09e9e4800d98 2023-11-11 04:55:37,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/2d11ffcdce93498a91bc4050e7f5bcea to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/2d11ffcdce93498a91bc4050e7f5bcea 2023-11-11 04:55:37,509 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 9935958aa309b992cb5f336e4bc6f510#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:37,917 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111190353156fda54e2dbc9dcf4ddf8c4b25_del 2023-11-11 04:55:37,917 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111190353156fda54e2dbc9dcf4ddf8c4b25_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023111190353156fda54e2dbc9dcf4ddf8c4b25_del 2023-11-11 04:55:38,730 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36cd5c26ecb34093899a0989664c2a46 2023-11-11 04:55:38,731 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/.tmp/family2/36cd5c26ecb34093899a0989664c2a46 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/36cd5c26ecb34093899a0989664c2a46 2023-11-11 04:55:38,734 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36cd5c26ecb34093899a0989664c2a46 2023-11-11 04:55:38,735 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9935958aa309b992cb5f336e4bc6f510/family2 of 9935958aa309b992cb5f336e4bc6f510 into 36cd5c26ecb34093899a0989664c2a46(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:55:38,735 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 9935958aa309b992cb5f336e4bc6f510: 2023-11-11 04:55:38,735 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:38,735 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): d33048759c13f557d932f58e5b37d029/family1 is initiating major compaction (all files) 2023-11-11 04:55:38,735 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:38,735 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:38,736 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of d33048759c13f557d932f58e5b37d029/family1 in ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:38,736 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/b4d7f768de444e69ba89afa150455f47, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/6a8de13980334ccc9dd69a3161763e4b, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/720e0ea8afc04ce6b5347af4b53b2925, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/c12ffffa86554b96a4af4ad2343bc214, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/bf2a071d84ff431dabf2614950b8fbcb] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp, totalSize=26.6 K 2023-11-11 04:55:38,736 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting b4d7f768de444e69ba89afa150455f47, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678528876 2023-11-11 04:55:38,737 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 6a8de13980334ccc9dd69a3161763e4b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678530265 2023-11-11 04:55:38,737 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 720e0ea8afc04ce6b5347af4b53b2925, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678532065 2023-11-11 04:55:38,737 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting c12ffffa86554b96a4af4ad2343bc214, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678533867 2023-11-11 04:55:38,738 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting bf2a071d84ff431dabf2614950b8fbcb, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:55:38,747 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): d33048759c13f557d932f58e5b37d029#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:38,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/04bf4f8d26d14f26896e0ae049782e13, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6fd9c910128d485bb6d7a215988392e3, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7f4195e9639748e0a67253a11fce9a9f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7cd1d5dc896348aa9845963baa1665d9, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6f0b8a67abb449868cbbe5fb0cfa2848] to archive 2023-11-11 04:55:38,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:38,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/04bf4f8d26d14f26896e0ae049782e13 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/04bf4f8d26d14f26896e0ae049782e13 2023-11-11 04:55:38,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6fd9c910128d485bb6d7a215988392e3 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6fd9c910128d485bb6d7a215988392e3 2023-11-11 04:55:38,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7f4195e9639748e0a67253a11fce9a9f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7f4195e9639748e0a67253a11fce9a9f 2023-11-11 04:55:38,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7cd1d5dc896348aa9845963baa1665d9 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/7cd1d5dc896348aa9845963baa1665d9 2023-11-11 04:55:38,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6f0b8a67abb449868cbbe5fb0cfa2848 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family2/6f0b8a67abb449868cbbe5fb0cfa2848 2023-11-11 04:55:39,155 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111111367a0d2ac04e6b948725295e0f30bd_del 2023-11-11 04:55:39,155 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111111367a0d2ac04e6b948725295e0f30bd_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023111111367a0d2ac04e6b948725295e0f30bd_del 2023-11-11 04:55:39,969 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 482ad19f9ef648d2a9843b3ca6c1b69f 2023-11-11 04:55:39,970 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family1/482ad19f9ef648d2a9843b3ca6c1b69f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/482ad19f9ef648d2a9843b3ca6c1b69f 2023-11-11 04:55:39,973 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 482ad19f9ef648d2a9843b3ca6c1b69f 2023-11-11 04:55:39,974 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d33048759c13f557d932f58e5b37d029/family1 of d33048759c13f557d932f58e5b37d029 into 482ad19f9ef648d2a9843b3ca6c1b69f(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:55:39,974 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for d33048759c13f557d932f58e5b37d029: 2023-11-11 04:55:39,974 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:39,974 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): d33048759c13f557d932f58e5b37d029/family2 is initiating major compaction (all files) 2023-11-11 04:55:39,975 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:39,975 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:39,976 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of d33048759c13f557d932f58e5b37d029/family2 in ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:55:39,976 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/068ccbbcb871402da31d2953d60b1a93, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/2bc5ae4a366d451a9f2bb45ec340e82f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/86b2283cde7b43239c332fee20867a24, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/ad0000b6f20344068aef0463bf027b9f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/eee92cb9e3784c80b14c9775ef824fc7] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp, totalSize=25.3 K 2023-11-11 04:55:39,976 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 068ccbbcb871402da31d2953d60b1a93, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678528876 2023-11-11 04:55:39,976 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 2bc5ae4a366d451a9f2bb45ec340e82f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678530265 2023-11-11 04:55:39,977 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 86b2283cde7b43239c332fee20867a24, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678532065 2023-11-11 04:55:39,977 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting ad0000b6f20344068aef0463bf027b9f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678533867 2023-11-11 04:55:39,977 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting eee92cb9e3784c80b14c9775ef824fc7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:55:39,990 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): d33048759c13f557d932f58e5b37d029#family2#compaction#153 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:39,998 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/b4d7f768de444e69ba89afa150455f47, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/6a8de13980334ccc9dd69a3161763e4b, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/720e0ea8afc04ce6b5347af4b53b2925, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/c12ffffa86554b96a4af4ad2343bc214, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/bf2a071d84ff431dabf2614950b8fbcb] to archive 2023-11-11 04:55:39,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:40,000 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/b4d7f768de444e69ba89afa150455f47 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/b4d7f768de444e69ba89afa150455f47 2023-11-11 04:55:40,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/6a8de13980334ccc9dd69a3161763e4b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/6a8de13980334ccc9dd69a3161763e4b 2023-11-11 04:55:40,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/720e0ea8afc04ce6b5347af4b53b2925 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/720e0ea8afc04ce6b5347af4b53b2925 2023-11-11 04:55:40,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/c12ffffa86554b96a4af4ad2343bc214 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/c12ffffa86554b96a4af4ad2343bc214 2023-11-11 04:55:40,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/bf2a071d84ff431dabf2614950b8fbcb to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/bf2a071d84ff431dabf2614950b8fbcb 2023-11-11 04:55:40,402 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311113d0156be75944e379350bea0b963f44b_del 2023-11-11 04:55:40,402 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311113d0156be75944e379350bea0b963f44b_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311113d0156be75944e379350bea0b963f44b_del 2023-11-11 04:55:41,217 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68f30d8cff37458a9d2af0891c997a18 2023-11-11 04:55:41,218 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/.tmp/family2/68f30d8cff37458a9d2af0891c997a18 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/68f30d8cff37458a9d2af0891c997a18 2023-11-11 04:55:41,222 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68f30d8cff37458a9d2af0891c997a18 2023-11-11 04:55:41,223 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d33048759c13f557d932f58e5b37d029/family2 of d33048759c13f557d932f58e5b37d029 into 68f30d8cff37458a9d2af0891c997a18(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:55:41,223 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for d33048759c13f557d932f58e5b37d029: 2023-11-11 04:55:41,223 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:41,223 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 4d006bc838d3353e4d8b7fad62c39f9d/family1 is initiating major compaction (all files) 2023-11-11 04:55:41,223 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:41,223 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:41,224 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 4d006bc838d3353e4d8b7fad62c39f9d/family1 in ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:41,224 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/624beaf2c4924468ab59ff0f413dbc32, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/cbe7194098654f55a902ae019571d38e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/5a4bb3c9d33845e5a60a59717654cf4f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/2855eab266644af19e50390c8ca738c5, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/48af898f9d9748cc9e34993b4cf0fb3e] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp, totalSize=26.6 K 2023-11-11 04:55:41,224 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 624beaf2c4924468ab59ff0f413dbc32, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678528877 2023-11-11 04:55:41,224 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting cbe7194098654f55a902ae019571d38e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678530265 2023-11-11 04:55:41,225 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 5a4bb3c9d33845e5a60a59717654cf4f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678532066 2023-11-11 04:55:41,225 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 2855eab266644af19e50390c8ca738c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678533868 2023-11-11 04:55:41,225 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 48af898f9d9748cc9e34993b4cf0fb3e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:55:41,234 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 4d006bc838d3353e4d8b7fad62c39f9d#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:41,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/068ccbbcb871402da31d2953d60b1a93, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/2bc5ae4a366d451a9f2bb45ec340e82f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/86b2283cde7b43239c332fee20867a24, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/ad0000b6f20344068aef0463bf027b9f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/eee92cb9e3784c80b14c9775ef824fc7] to archive 2023-11-11 04:55:41,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:41,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/068ccbbcb871402da31d2953d60b1a93 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/068ccbbcb871402da31d2953d60b1a93 2023-11-11 04:55:41,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/2bc5ae4a366d451a9f2bb45ec340e82f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/2bc5ae4a366d451a9f2bb45ec340e82f 2023-11-11 04:55:41,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/86b2283cde7b43239c332fee20867a24 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/86b2283cde7b43239c332fee20867a24 2023-11-11 04:55:41,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/ad0000b6f20344068aef0463bf027b9f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/ad0000b6f20344068aef0463bf027b9f 2023-11-11 04:55:41,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/eee92cb9e3784c80b14c9775ef824fc7 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family2/eee92cb9e3784c80b14c9775ef824fc7 2023-11-11 04:55:41,647 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311117b26b17bb3644581a3d3fd451838995a_del 2023-11-11 04:55:41,647 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311117b26b17bb3644581a3d3fd451838995a_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311117b26b17bb3644581a3d3fd451838995a_del 2023-11-11 04:55:42,460 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e8b859884a1425bab8bbfaf1f4390d1 2023-11-11 04:55:42,461 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family1/6e8b859884a1425bab8bbfaf1f4390d1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/6e8b859884a1425bab8bbfaf1f4390d1 2023-11-11 04:55:42,464 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e8b859884a1425bab8bbfaf1f4390d1 2023-11-11 04:55:42,465 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4d006bc838d3353e4d8b7fad62c39f9d/family1 of 4d006bc838d3353e4d8b7fad62c39f9d into 6e8b859884a1425bab8bbfaf1f4390d1(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:55:42,465 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 4d006bc838d3353e4d8b7fad62c39f9d: 2023-11-11 04:55:42,465 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:55:42,466 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 4d006bc838d3353e4d8b7fad62c39f9d/family2 is initiating major compaction (all files) 2023-11-11 04:55:42,466 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:55:42,466 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:55:42,466 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 4d006bc838d3353e4d8b7fad62c39f9d/family2 in ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:55:42,466 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/c4313ccaca694e15a804dc9d0b9f34b2, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/51b6ea80ef1f49dabe00f7cb63bba37d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/09180e577bfe421690628196b998473d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/9703f5d70ac34befaf08601acb316489, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/2ebdaec7ed9f46148b1d31078dab9680] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp, totalSize=25.3 K 2023-11-11 04:55:42,466 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting c4313ccaca694e15a804dc9d0b9f34b2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678528877 2023-11-11 04:55:42,467 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 51b6ea80ef1f49dabe00f7cb63bba37d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678530265 2023-11-11 04:55:42,467 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 09180e577bfe421690628196b998473d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678532066 2023-11-11 04:55:42,467 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 9703f5d70ac34befaf08601acb316489, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678533868 2023-11-11 04:55:42,468 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 2ebdaec7ed9f46148b1d31078dab9680, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:55:42,476 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 4d006bc838d3353e4d8b7fad62c39f9d#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:55:42,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/624beaf2c4924468ab59ff0f413dbc32, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/cbe7194098654f55a902ae019571d38e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/5a4bb3c9d33845e5a60a59717654cf4f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/2855eab266644af19e50390c8ca738c5, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/48af898f9d9748cc9e34993b4cf0fb3e] to archive 2023-11-11 04:55:42,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:42,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/624beaf2c4924468ab59ff0f413dbc32 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/624beaf2c4924468ab59ff0f413dbc32 2023-11-11 04:55:42,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/cbe7194098654f55a902ae019571d38e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/cbe7194098654f55a902ae019571d38e 2023-11-11 04:55:42,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/5a4bb3c9d33845e5a60a59717654cf4f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/5a4bb3c9d33845e5a60a59717654cf4f 2023-11-11 04:55:42,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/2855eab266644af19e50390c8ca738c5 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/2855eab266644af19e50390c8ca738c5 2023-11-11 04:55:42,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/48af898f9d9748cc9e34993b4cf0fb3e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/48af898f9d9748cc9e34993b4cf0fb3e 2023-11-11 04:55:42,884 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111b31b91b054e24756852445e880cf797a_del 2023-11-11 04:55:42,885 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111b31b91b054e24756852445e880cf797a_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231111b31b91b054e24756852445e880cf797a_del 2023-11-11 04:55:43,698 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9ba5cdb40f6491a823b7e4fd25f37c9 2023-11-11 04:55:43,699 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/.tmp/family2/e9ba5cdb40f6491a823b7e4fd25f37c9 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/e9ba5cdb40f6491a823b7e4fd25f37c9 2023-11-11 04:55:43,702 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9ba5cdb40f6491a823b7e4fd25f37c9 2023-11-11 04:55:43,703 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4d006bc838d3353e4d8b7fad62c39f9d/family2 of 4d006bc838d3353e4d8b7fad62c39f9d into e9ba5cdb40f6491a823b7e4fd25f37c9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:55:43,703 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 4d006bc838d3353e4d8b7fad62c39f9d: 2023-11-11 04:55:43,706 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:43,709 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:43,713 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:43,714 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:43,720 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 04:55:43,734 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-11 04:55:43,737 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111111367a0d2ac04e6b948725295e0f30bd_del 2023-11-11 04:55:43,739 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231111030b04841c384686a5ac3f35e53cd795_del 2023-11-11 04:55:43,742 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311117b26b17bb3644581a3d3fd451838995a_del 2023-11-11 04:55:43,742 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-11 04:55:43,743 DEBUG [Listener at localhost/35271] zookeeper.ReadOnlyZKClient(139): Connect 0x460c308f to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:55:43,748 DEBUG [Listener at localhost/35271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dad61c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:55:43,749 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 04:55:43,749 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 04:55:43,749 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 04:55:43,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/c4313ccaca694e15a804dc9d0b9f34b2, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/51b6ea80ef1f49dabe00f7cb63bba37d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/09180e577bfe421690628196b998473d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/9703f5d70ac34befaf08601acb316489, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/2ebdaec7ed9f46148b1d31078dab9680] to archive 2023-11-11 04:55:43,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:43,801 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/c4313ccaca694e15a804dc9d0b9f34b2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/c4313ccaca694e15a804dc9d0b9f34b2 2023-11-11 04:55:43,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/51b6ea80ef1f49dabe00f7cb63bba37d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/51b6ea80ef1f49dabe00f7cb63bba37d 2023-11-11 04:55:43,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/09180e577bfe421690628196b998473d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/09180e577bfe421690628196b998473d 2023-11-11 04:55:43,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/9703f5d70ac34befaf08601acb316489 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/9703f5d70ac34befaf08601acb316489 2023-11-11 04:55:43,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/2ebdaec7ed9f46148b1d31078dab9680 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family2/2ebdaec7ed9f46148b1d31078dab9680 2023-11-11 04:55:44,193 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111fb508e27cc6a4a8bbf1685bff2d83ea7 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231111fb508e27cc6a4a8bbf1685bff2d83ea7 2023-11-11 04:55:44,194 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 04:55:44,214 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:55:44,217 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:55:44,225 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:55:44,228 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:55:44,241 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231111/family1/82768c7735b44df689abc8cbae6b65e0 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-11 04:55:44,242 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231111/family1/82768c7735b44df689abc8cbae6b65e0}] 2023-11-11 04:55:44,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231111/family1/82768c7735b44df689abc8cbae6b65e0 for inclusion in 9935958aa309b992cb5f336e4bc6f510/family1 2023-11-11 04:55:44,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-11 04:55:44,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-11 04:55:44,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 9935958aa309b992cb5f336e4bc6f510: 2023-11-11 04:55:44,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231111/family1/82768c7735b44df689abc8cbae6b65e0 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__gnls8civ9q5h1l3k10smi42ivakam9seefg1le3mjel7dh2rv204l9n4q1gndt94/family1/82768c7735b44df689abc8cbae6b65e0 2023-11-11 04:55:44,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__gnls8civ9q5h1l3k10smi42ivakam9seefg1le3mjel7dh2rv204l9n4q1gndt94/family1/82768c7735b44df689abc8cbae6b65e0 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/ce2bf34c2a75462c8446a813cc9076c3_SeqId_28_ 2023-11-11 04:55:44,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__gnls8civ9q5h1l3k10smi42ivakam9seefg1le3mjel7dh2rv204l9n4q1gndt94/family1/82768c7735b44df689abc8cbae6b65e0 into 9935958aa309b992cb5f336e4bc6f510/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/ce2bf34c2a75462c8446a813cc9076c3_SeqId_28_ - updating store file list. 2023-11-11 04:55:44,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/ce2bf34c2a75462c8446a813cc9076c3_SeqId_28_ into 9935958aa309b992cb5f336e4bc6f510/family1 2023-11-11 04:55:44,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__gnls8civ9q5h1l3k10smi42ivakam9seefg1le3mjel7dh2rv204l9n4q1gndt94/family1/82768c7735b44df689abc8cbae6b65e0 into 9935958aa309b992cb5f336e4bc6f510/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/family1/ce2bf34c2a75462c8446a813cc9076c3_SeqId_28_) 2023-11-11 04:55:44,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__gnls8civ9q5h1l3k10smi42ivakam9seefg1le3mjel7dh2rv204l9n4q1gndt94/family1/82768c7735b44df689abc8cbae6b65e0 2023-11-11 04:55:44,260 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 04:55:44,261 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:44,263 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311115902b592630841108c03a80df59f09bd to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311115902b592630841108c03a80df59f09bd 2023-11-11 04:55:44,263 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-11 04:55:44,263 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231111' 2023-11-11 04:55:44,264 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 04:55:44,587 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111bb27acbc0ef84b95bfa78050f02e88e4 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111bb27acbc0ef84b95bfa78050f02e88e4 2023-11-11 04:55:44,587 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311115fb20250d61d4a9bb6edb7c7e6b87a20 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311115fb20250d61d4a9bb6edb7c7e6b87a20 2023-11-11 04:55:44,588 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 04:55:44,588 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 04:55:44,611 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/family1/40711ebd57a24d858856486f8379d30d first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-11 04:55:44,611 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231111/family1/8dcc7f0f43be4da1ac9829dd4fd1fe2d first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-11 04:55:44,612 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/family1/40711ebd57a24d858856486f8379d30d}] 2023-11-11 04:55:44,612 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231111/family1/8dcc7f0f43be4da1ac9829dd4fd1fe2d}] 2023-11-11 04:55:44,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231111/family1/8dcc7f0f43be4da1ac9829dd4fd1fe2d for inclusion in 4d006bc838d3353e4d8b7fad62c39f9d/family1 2023-11-11 04:55:44,615 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/family1/40711ebd57a24d858856486f8379d30d for inclusion in d33048759c13f557d932f58e5b37d029/family1 2023-11-11 04:55:44,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-11 04:55:44,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-11 04:55:44,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-11 04:55:44,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last=1 2023-11-11 04:55:44,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 4d006bc838d3353e4d8b7fad62c39f9d: 2023-11-11 04:55:44,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for d33048759c13f557d932f58e5b37d029: 2023-11-11 04:55:44,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/family1/40711ebd57a24d858856486f8379d30d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__hsa6ki8hidra87uq658d501rl375ir386q3s6a85r13j1a6lrf960tagrmp9bdof/family1/40711ebd57a24d858856486f8379d30d 2023-11-11 04:55:44,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231111/family1/8dcc7f0f43be4da1ac9829dd4fd1fe2d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__q5qfbdlcfdc0de07itkggmc5nm2ovarls7ts70nisgt7mitocflmut4rtadhhno7/family1/8dcc7f0f43be4da1ac9829dd4fd1fe2d 2023-11-11 04:55:44,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__hsa6ki8hidra87uq658d501rl375ir386q3s6a85r13j1a6lrf960tagrmp9bdof/family1/40711ebd57a24d858856486f8379d30d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/24daf77ab2fb490dadbd9bbf4c8ac351_SeqId_28_ 2023-11-11 04:55:44,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__q5qfbdlcfdc0de07itkggmc5nm2ovarls7ts70nisgt7mitocflmut4rtadhhno7/family1/8dcc7f0f43be4da1ac9829dd4fd1fe2d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/4108c3c09cec4d438212affe7d3d3807_SeqId_28_ 2023-11-11 04:55:44,620 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__hsa6ki8hidra87uq658d501rl375ir386q3s6a85r13j1a6lrf960tagrmp9bdof/family1/40711ebd57a24d858856486f8379d30d into d33048759c13f557d932f58e5b37d029/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/24daf77ab2fb490dadbd9bbf4c8ac351_SeqId_28_ - updating store file list. 2023-11-11 04:55:44,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__q5qfbdlcfdc0de07itkggmc5nm2ovarls7ts70nisgt7mitocflmut4rtadhhno7/family1/8dcc7f0f43be4da1ac9829dd4fd1fe2d into 4d006bc838d3353e4d8b7fad62c39f9d/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/4108c3c09cec4d438212affe7d3d3807_SeqId_28_ - updating store file list. 2023-11-11 04:55:44,623 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/24daf77ab2fb490dadbd9bbf4c8ac351_SeqId_28_ into d33048759c13f557d932f58e5b37d029/family1 2023-11-11 04:55:44,623 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__hsa6ki8hidra87uq658d501rl375ir386q3s6a85r13j1a6lrf960tagrmp9bdof/family1/40711ebd57a24d858856486f8379d30d into d33048759c13f557d932f58e5b37d029/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/family1/24daf77ab2fb490dadbd9bbf4c8ac351_SeqId_28_) 2023-11-11 04:55:44,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/4108c3c09cec4d438212affe7d3d3807_SeqId_28_ into 4d006bc838d3353e4d8b7fad62c39f9d/family1 2023-11-11 04:55:44,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__q5qfbdlcfdc0de07itkggmc5nm2ovarls7ts70nisgt7mitocflmut4rtadhhno7/family1/8dcc7f0f43be4da1ac9829dd4fd1fe2d into 4d006bc838d3353e4d8b7fad62c39f9d/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/family1/4108c3c09cec4d438212affe7d3d3807_SeqId_28_) 2023-11-11 04:55:44,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__hsa6ki8hidra87uq658d501rl375ir386q3s6a85r13j1a6lrf960tagrmp9bdof/family1/40711ebd57a24d858856486f8379d30d 2023-11-11 04:55:44,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__ns_testMinorCompaction__q5qfbdlcfdc0de07itkggmc5nm2ovarls7ts70nisgt7mitocflmut4rtadhhno7/family1/8dcc7f0f43be4da1ac9829dd4fd1fe2d 2023-11-11 04:55:44,626 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 04:55:44,626 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 04:55:44,626 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:44,626 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:44,628 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111a46c181f623f4880a7646c24ec953bd1 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111a46c181f623f4880a7646c24ec953bd1 2023-11-11 04:55:44,628 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-11 04:55:44,628 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231111' 2023-11-11 04:55:44,628 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311116d28645d991347db89271ed4c5dd42b2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311116d28645d991347db89271ed4c5dd42b2 2023-11-11 04:55:44,628 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-11 04:55:44,628 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231111' 2023-11-11 04:55:44,628 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 04:55:44,628 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 04:55:44,628 INFO [Listener at localhost/35271] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-11 04:55:44,631 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:44,632 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:44,635 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:55:44,635 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:55:44,655 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=251 (was 291), OpenFileDescriptor=658 (was 803), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 200) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=2402 (was 2351) - AvailableMemoryMB LEAK? - 2023-11-11 04:55:44,668 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=658, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=167, AvailableMemoryMB=2402 2023-11-11 04:55:44,670 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-11 04:55:44,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:44,671 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:55:44,672 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-11 04:55:44,672 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:55:44,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-11 04:55:44,673 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a 2023-11-11 04:55:44,674 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a empty. 2023-11-11 04:55:44,674 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a 2023-11-11 04:55:44,674 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-11 04:55:44,685 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-11 04:55:44,686 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => a36cd15569ca04bc0fc71a10e86f004a, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:55:44,690 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:44,690 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing a36cd15569ca04bc0fc71a10e86f004a, disabling compactions & flushes 2023-11-11 04:55:44,691 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:44,691 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:44,691 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. after waiting 0 ms 2023-11-11 04:55:44,691 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:44,691 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:44,691 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:44,692 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:55:44,693 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699678544693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678544693"}]},"ts":"1699678544693"} 2023-11-11 04:55:44,695 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 04:55:44,695 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:55:44,695 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678544695"}]},"ts":"1699678544695"} 2023-11-11 04:55:44,696 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-11 04:55:44,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a36cd15569ca04bc0fc71a10e86f004a, ASSIGN}] 2023-11-11 04:55:44,701 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a36cd15569ca04bc0fc71a10e86f004a, ASSIGN 2023-11-11 04:55:44,701 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a36cd15569ca04bc0fc71a10e86f004a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:55:44,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-11 04:55:44,852 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=a36cd15569ca04bc0fc71a10e86f004a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:44,852 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699678544852"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678544852"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678544852"}]},"ts":"1699678544852"} 2023-11-11 04:55:44,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure a36cd15569ca04bc0fc71a10e86f004a, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:44,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-11 04:55:45,005 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:45,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a36cd15569ca04bc0fc71a10e86f004a, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a.', STARTKEY => '', ENDKEY => ''} 2023-11-11 04:55:45,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy a36cd15569ca04bc0fc71a10e86f004a 2023-11-11 04:55:45,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:45,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a36cd15569ca04bc0fc71a10e86f004a 2023-11-11 04:55:45,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a36cd15569ca04bc0fc71a10e86f004a 2023-11-11 04:55:45,010 INFO [StoreOpener-a36cd15569ca04bc0fc71a10e86f004a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a36cd15569ca04bc0fc71a10e86f004a 2023-11-11 04:55:45,012 DEBUG [StoreOpener-a36cd15569ca04bc0fc71a10e86f004a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1 2023-11-11 04:55:45,013 DEBUG [StoreOpener-a36cd15569ca04bc0fc71a10e86f004a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1 2023-11-11 04:55:45,013 INFO [StoreOpener-a36cd15569ca04bc0fc71a10e86f004a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a36cd15569ca04bc0fc71a10e86f004a columnFamilyName family1 2023-11-11 04:55:45,014 INFO [StoreOpener-a36cd15569ca04bc0fc71a10e86f004a-1] regionserver.HStore(310): Store=a36cd15569ca04bc0fc71a10e86f004a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:45,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a 2023-11-11 04:55:45,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a 2023-11-11 04:55:45,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a36cd15569ca04bc0fc71a10e86f004a 2023-11-11 04:55:45,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:55:45,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a36cd15569ca04bc0fc71a10e86f004a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66312342, jitterRate=-0.011869102716445923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 04:55:45,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:45,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a., pid=114, masterSystemTime=1699678545005 2023-11-11 04:55:45,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:45,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:45,021 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=a36cd15569ca04bc0fc71a10e86f004a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,022 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699678545021"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678545021"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678545021"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678545021"}]},"ts":"1699678545021"} 2023-11-11 04:55:45,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-11 04:55:45,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure a36cd15569ca04bc0fc71a10e86f004a, server=jenkins-hbase4.apache.org,43941,1699678403879 in 169 msec 2023-11-11 04:55:45,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-11 04:55:45,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a36cd15569ca04bc0fc71a10e86f004a, ASSIGN in 325 msec 2023-11-11 04:55:45,025 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:55:45,025 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678545025"}]},"ts":"1699678545025"} 2023-11-11 04:55:45,026 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-11 04:55:45,028 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:55:45,029 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 358 msec 2023-11-11 04:55:45,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-11 04:55:45,275 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-11 04:55:45,293 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:45,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,297 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:45,297 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:45,297 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:55:45,297 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:55:45,298 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,298 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,300 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:45,300 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:45,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:45,300 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,300 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:45,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:45,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,301 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,303 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:55:45,303 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:45,303 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:55:45,303 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:55:45,303 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:45,303 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:45,303 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. started... 2023-11-11 04:55:45,304 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a36cd15569ca04bc0fc71a10e86f004a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 04:55:45,328 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113026725564af58417bbe06a4cd7d3efcbc to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113026725564af58417bbe06a4cd7d3efcbc 2023-11-11 04:55:45,331 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/ea27b595a28f4501b340ee39bdecf952 2023-11-11 04:55:45,335 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/ea27b595a28f4501b340ee39bdecf952 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/ea27b595a28f4501b340ee39bdecf952 2023-11-11 04:55:45,338 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/ea27b595a28f4501b340ee39bdecf952, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-11 04:55:45,339 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a36cd15569ca04bc0fc71a10e86f004a in 35ms, sequenceid=5, compaction requested=false 2023-11-11 04:55:45,339 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:45,340 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:45,340 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:45,340 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:55:45,340 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:55:45,340 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,340 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:55:45,340 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:55:45,346 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,346 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:45,347 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,347 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:45,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:55:45,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@573b4bef[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:45,348 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:55:45,349 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,350 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,350 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:55:45,350 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:55:45,350 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:45,350 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,350 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:45,352 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,352 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:55:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:45,352 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:45,352 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:55:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:45,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:45,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:55:45,354 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:55:45,354 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:45,354 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:45,354 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,354 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:45,357 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,357 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:45,357 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:45,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:45,357 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,358 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,360 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,360 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,360 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:45,360 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,361 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:45,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:45,361 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:45,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:45,361 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 04:55:45,361 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:45,361 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:45,361 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,361 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,361 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:45,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:45,361 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:45,361 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:45,461 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:45,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:45,466 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:45,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:45,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,467 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:45,467 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:45,467 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:55:45,467 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:55:45,468 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,468 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,469 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,469 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:45,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:45,470 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:45,470 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,470 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,471 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:55:45,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:55:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:55:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:55:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:45,471 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:45,471 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. started... 2023-11-11 04:55:45,471 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a36cd15569ca04bc0fc71a10e86f004a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 04:55:45,882 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112829e956dc7cfc4d648cf783b718c63bd0 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112829e956dc7cfc4d648cf783b718c63bd0 2023-11-11 04:55:46,287 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/52f7da292abb4d7bafbc96cf2b650738 2023-11-11 04:55:46,291 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/52f7da292abb4d7bafbc96cf2b650738 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/52f7da292abb4d7bafbc96cf2b650738 2023-11-11 04:55:46,294 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/52f7da292abb4d7bafbc96cf2b650738, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 04:55:46,295 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a36cd15569ca04bc0fc71a10e86f004a in 824ms, sequenceid=9, compaction requested=false 2023-11-11 04:55:46,295 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:46,295 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:46,296 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:55:46,296 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:55:46,296 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,296 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:55:46,296 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:55:46,298 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,298 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:46,298 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,298 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:46,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:55:46,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3db7a3d0[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:46,300 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:55:46,300 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,302 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,302 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:55:46,302 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:55:46,302 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:46,302 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,302 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:46,304 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:55:46,304 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,304 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:46,304 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:55:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:46,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:55:46,307 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:55:46,307 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:46,307 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:46,307 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,307 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:46,309 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,309 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,309 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:46,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,309 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:46,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:46,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:46,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,311 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:46,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,313 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,313 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,313 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,313 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,313 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:46,313 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:46,313 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:46,313 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:46,313 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:46,313 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:46,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 04:55:46,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:46,313 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,314 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,314 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:46,314 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:46,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:46,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:46,414 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:46,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:46,419 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:46,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:46,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,420 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:46,420 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:46,420 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:55:46,420 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:55:46,421 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,421 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,423 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,423 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:46,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:46,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:46,424 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,424 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:46,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,425 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,425 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:55:46,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,425 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:55:46,425 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:46,425 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:55:46,425 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:55:46,425 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:46,425 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:46,425 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. started... 2023-11-11 04:55:46,425 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a36cd15569ca04bc0fc71a10e86f004a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:55:46,436 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512019cf4ebcba1c849d99cf507f1836503d0 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512019cf4ebcba1c849d99cf507f1836503d0 2023-11-11 04:55:46,447 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/43650124ae9d47bb90327e6c59f36de5 2023-11-11 04:55:46,451 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/43650124ae9d47bb90327e6c59f36de5 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/43650124ae9d47bb90327e6c59f36de5 2023-11-11 04:55:46,454 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/43650124ae9d47bb90327e6c59f36de5, entries=1, sequenceid=13, filesize=4.9 K 2023-11-11 04:55:46,455 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a36cd15569ca04bc0fc71a10e86f004a in 30ms, sequenceid=13, compaction requested=true 2023-11-11 04:55:46,455 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:46,455 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:46,455 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:55:46,455 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:55:46,455 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,455 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:55:46,455 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:55:46,457 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,457 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:46,457 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,457 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:46,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:55:46,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15453126[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:46,459 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:55:46,459 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,460 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,460 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:55:46,460 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:55:46,460 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:46,460 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,460 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:46,461 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:55:46,461 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,461 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,462 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:55:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:46,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:46,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:46,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:46,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:55:46,464 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:55:46,465 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:46,465 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:46,465 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,465 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:46,471 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,471 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:46,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,471 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:46,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:46,472 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,473 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:46,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,479 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,479 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,479 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:46,479 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,479 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:46,479 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:46,479 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:46,479 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:46,479 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:46,479 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,479 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,479 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,479 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:46,479 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:46,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:46,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:46,580 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:46,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:46,584 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:46,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:46,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,585 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:46,585 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:46,585 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:55:46,585 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:55:46,586 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,586 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,587 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,587 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:46,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:46,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:46,587 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:46,588 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,588 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,589 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:55:46,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:46,589 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:55:46,589 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:46,589 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:55:46,589 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:55:46,589 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:46,589 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:46,589 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. started... 2023-11-11 04:55:46,589 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a36cd15569ca04bc0fc71a10e86f004a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:55:47,000 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053e68a56c44084f5e98b22bfc01f507fb to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512053e68a56c44084f5e98b22bfc01f507fb 2023-11-11 04:55:47,405 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/2fe3e936b12845a0952869d52d8bc966 2023-11-11 04:55:47,409 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/2fe3e936b12845a0952869d52d8bc966 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2fe3e936b12845a0952869d52d8bc966 2023-11-11 04:55:47,412 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2fe3e936b12845a0952869d52d8bc966, entries=1, sequenceid=17, filesize=4.9 K 2023-11-11 04:55:47,413 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a36cd15569ca04bc0fc71a10e86f004a in 824ms, sequenceid=17, compaction requested=true 2023-11-11 04:55:47,413 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:47,413 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:55:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:55:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:55:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:55:47,414 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,414 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:47,415 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,415 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:47,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:55:47,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f6d6835[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:47,416 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:55:47,416 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,418 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:55:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:55:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:47,418 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,418 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:55:47,420 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:55:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:47,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:55:47,422 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:55:47,422 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:47,422 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:47,422 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,422 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:47,423 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,423 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:47,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,424 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:47,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:47,424 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,425 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,427 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,427 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:47,428 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:47,428 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:47,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 04:55:47,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:47,428 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:47,428 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:47,428 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,428 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:47,428 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,428 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,428 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,428 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:47,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:47,428 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:47,428 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:47,528 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:47,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:47,532 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:47,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:47,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,534 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:47,534 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:47,534 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:55:47,534 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:55:47,534 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,535 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,537 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:47,537 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:47,537 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:47,537 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,538 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,538 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:55:47,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:47,538 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:55:47,538 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:47,538 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:55:47,539 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:55:47,539 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:47,539 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:47,539 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. started... 2023-11-11 04:55:47,539 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a36cd15569ca04bc0fc71a10e86f004a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:55:47,950 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a5e322a74bc54e679a2c4d075e82ef62 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228a5e322a74bc54e679a2c4d075e82ef62 2023-11-11 04:55:48,355 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/3837db0bcc264945abbb7c617b86130d 2023-11-11 04:55:48,359 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/3837db0bcc264945abbb7c617b86130d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/3837db0bcc264945abbb7c617b86130d 2023-11-11 04:55:48,362 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/3837db0bcc264945abbb7c617b86130d, entries=1, sequenceid=21, filesize=4.9 K 2023-11-11 04:55:48,363 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a36cd15569ca04bc0fc71a10e86f004a in 824ms, sequenceid=21, compaction requested=true 2023-11-11 04:55:48,363 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:48,363 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:55:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:55:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:55:48,363 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:55:48,365 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,365 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:48,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:48,365 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,365 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:48,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:48,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:48,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:48,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:55:48,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22043a04[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:48,366 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:55:48,367 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,368 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,368 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:55:48,368 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:55:48,368 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:48,368 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,368 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:48,369 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:55:48,369 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:48,369 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,369 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:55:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:48,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:55:48,372 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:55:48,372 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:48,372 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:48,372 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,372 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:48,375 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,375 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,375 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:48,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:48,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:48,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:48,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:48,375 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:48,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,377 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,379 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,379 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:48,379 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:48,379 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:48,379 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:48,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 04:55:48,379 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:48,379 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:48,379 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,380 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,380 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,380 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:48,380 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,380 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:48,380 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:48,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:48,480 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:48,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:48,484 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:48,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:48,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,486 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:48,486 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:48,486 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:55:48,486 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:55:48,486 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,486 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,487 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,488 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:48,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:48,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:48,488 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,488 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:48,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:48,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,489 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,489 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:55:48,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,489 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:55:48,489 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:48,489 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:55:48,489 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:55:48,489 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:48,489 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:48,489 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. started... 2023-11-11 04:55:48,489 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a36cd15569ca04bc0fc71a10e86f004a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:55:48,901 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315e31e6f1b2c84ae5a00afe0a0ae9a11c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512315e31e6f1b2c84ae5a00afe0a0ae9a11c 2023-11-11 04:55:48,906 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/0c01a3a795b84861966d98abca86677e 2023-11-11 04:55:48,910 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/0c01a3a795b84861966d98abca86677e as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/0c01a3a795b84861966d98abca86677e 2023-11-11 04:55:48,913 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/0c01a3a795b84861966d98abca86677e, entries=1, sequenceid=25, filesize=4.9 K 2023-11-11 04:55:48,914 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a36cd15569ca04bc0fc71a10e86f004a in 425ms, sequenceid=25, compaction requested=true 2023-11-11 04:55:48,914 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:48,914 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:48,914 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:55:48,914 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:55:48,914 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,914 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:55:48,914 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:55:48,916 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22adb4b7[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:48,918 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:55:48,918 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,920 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,920 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:55:48,920 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:55:48,920 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:48,920 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,920 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:48,927 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:55:48,927 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,927 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:48,927 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:55:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:48,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:48,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:55:48,930 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:55:48,930 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:48,930 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:48,930 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,930 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:48,931 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,931 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:48,932 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,932 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,933 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:48,936 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,936 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:48,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 04:55:48,936 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:48,936 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:48,936 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:48,936 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:48,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:49,036 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:49,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:49,041 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:49,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:49,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,042 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:49,042 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:49,042 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:55:49,042 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:55:49,043 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,043 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,044 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,044 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:49,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:49,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:49,044 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,044 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:49,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:49,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,045 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,045 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:55:49,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,045 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:55:49,045 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:49,045 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:55:49,046 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:55:49,046 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:49,046 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:49,046 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. started... 2023-11-11 04:55:49,046 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a36cd15569ca04bc0fc71a10e86f004a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:55:49,456 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101b971868900c74144b95f5f3db10e734e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b971868900c74144b95f5f3db10e734e 2023-11-11 04:55:49,861 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/af98fdd66fbd4489853cfae16b225537 2023-11-11 04:55:49,864 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/af98fdd66fbd4489853cfae16b225537 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/af98fdd66fbd4489853cfae16b225537 2023-11-11 04:55:49,868 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/af98fdd66fbd4489853cfae16b225537, entries=1, sequenceid=29, filesize=4.9 K 2023-11-11 04:55:49,869 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a36cd15569ca04bc0fc71a10e86f004a in 823ms, sequenceid=29, compaction requested=true 2023-11-11 04:55:49,869 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:49,869 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:55:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:55:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:55:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:55:49,871 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,871 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:49,871 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,871 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:49,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:49,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:55:49,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1edd7dc5[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:49,872 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:55:49,872 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,874 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,874 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:55:49,874 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:55:49,874 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:49,874 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,874 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:49,875 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:55:49,875 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:49,875 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,876 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:55:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:49,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:55:49,878 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:55:49,878 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:49,878 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:49,878 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,878 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:49,881 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,881 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:49,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,881 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:49,881 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,883 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,885 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,885 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,885 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,885 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,885 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,885 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:49,885 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:49,885 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:49,886 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:49,885 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:49,886 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:49,886 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,886 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:49,886 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:49,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:49,986 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:49,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:49,991 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:49,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:49,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,992 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:49,992 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:49,992 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:55:49,992 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:55:49,993 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,993 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,994 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,994 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:49,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:49,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:49,994 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:49,994 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:49,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:49,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,995 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,995 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:55:49,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:55:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:55:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:55:49,996 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:49,996 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:49,996 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. started... 2023-11-11 04:55:49,996 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a36cd15569ca04bc0fc71a10e86f004a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:55:50,406 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030c88ac47a14048629f74fb56764976ad to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601030c88ac47a14048629f74fb56764976ad 2023-11-11 04:55:50,549 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:55:50,811 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/a6d9a40aa5fb4bc09dadb76b2f7c4d21 2023-11-11 04:55:50,815 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/a6d9a40aa5fb4bc09dadb76b2f7c4d21 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/a6d9a40aa5fb4bc09dadb76b2f7c4d21 2023-11-11 04:55:50,819 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/a6d9a40aa5fb4bc09dadb76b2f7c4d21, entries=1, sequenceid=33, filesize=4.9 K 2023-11-11 04:55:50,820 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a36cd15569ca04bc0fc71a10e86f004a in 824ms, sequenceid=33, compaction requested=true 2023-11-11 04:55:50,820 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:50,820 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:50,820 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:55:50,820 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:55:50,820 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,820 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:55:50,820 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:55:50,822 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,822 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:50,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:50,822 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,822 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:50,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:50,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:50,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:50,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:55:50,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ab582eb[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:50,823 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:55:50,823 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,825 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,825 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:55:50,825 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:55:50,825 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:50,826 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,826 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:50,827 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:55:50,827 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:50,827 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,827 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:55:50,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:50,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:50,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:50,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:50,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:50,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:50,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:55:50,830 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:55:50,830 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:50,830 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:50,830 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,830 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:50,831 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,831 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,831 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:50,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:50,832 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,833 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:50,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:50,835 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:50,835 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:50,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:50,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 04:55:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:50,835 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:50,836 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:50,835 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,836 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:50,836 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,836 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,836 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:50,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:50,936 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:50,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:50,940 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:50,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:50,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,942 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:50,942 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:50,942 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:55:50,942 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:55:50,942 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,942 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,945 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,945 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:50,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:50,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:50,945 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:50,945 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:50,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:50,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,946 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,946 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:55:50,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:50,946 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:55:50,946 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:50,946 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:55:50,947 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:55:50,947 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:50,947 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:50,947 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. started... 2023-11-11 04:55:50,947 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a36cd15569ca04bc0fc71a10e86f004a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:55:51,357 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073e6fde234118413da8ca734b51e35184 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509073e6fde234118413da8ca734b51e35184 2023-11-11 04:55:51,762 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/ca1d7c9ee3c94d0b8616e63aee1c4b31 2023-11-11 04:55:51,766 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/ca1d7c9ee3c94d0b8616e63aee1c4b31 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/ca1d7c9ee3c94d0b8616e63aee1c4b31 2023-11-11 04:55:51,769 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/ca1d7c9ee3c94d0b8616e63aee1c4b31, entries=1, sequenceid=37, filesize=4.9 K 2023-11-11 04:55:51,770 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a36cd15569ca04bc0fc71a10e86f004a in 823ms, sequenceid=37, compaction requested=true 2023-11-11 04:55:51,770 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:51,770 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:51,770 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:55:51,770 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:55:51,770 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,770 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:55:51,770 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:55:51,774 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,774 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:51,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:51,775 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:51,775 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:51,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:51,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:51,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:55:51,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@596257a3[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:51,776 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:55:51,776 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,777 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,778 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:55:51,778 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,778 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:51,778 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:55:51,778 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:51,780 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,780 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:55:51,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,780 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:51,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:51,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:51,780 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:55:51,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:51,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:51,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:51,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:55:51,783 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:55:51,783 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:51,783 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:51,783 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,783 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:51,784 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,784 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,784 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:51,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:51,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:51,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:51,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:51,785 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:51,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,786 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:51,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,789 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,789 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,789 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,789 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:51,789 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,789 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,789 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:51,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 04:55:51,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:51,789 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:51,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:51,789 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:51,789 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:51,789 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,789 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:51,790 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:51,790 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:51,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:51,890 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:51,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:51,894 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:51,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:51,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,896 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:51,896 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:51,896 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 04:55:51,896 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 04:55:51,896 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,896 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,898 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:51,898 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:51,898 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:51,898 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:51,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:51,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,899 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,899 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 04:55:51,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:51,899 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 04:55:51,899 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:51,899 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 04:55:51,899 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 04:55:51,899 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:51,899 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:51,899 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. started... 2023-11-11 04:55:51,899 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a36cd15569ca04bc0fc71a10e86f004a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 04:55:52,310 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120542f641ff6804476a2857a84ba9939e8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120542f641ff6804476a2857a84ba9939e8 2023-11-11 04:55:52,715 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/4fe8a2bb170a4dad9a2dc81bfbe56f7d 2023-11-11 04:55:52,719 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/4fe8a2bb170a4dad9a2dc81bfbe56f7d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/4fe8a2bb170a4dad9a2dc81bfbe56f7d 2023-11-11 04:55:52,723 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/4fe8a2bb170a4dad9a2dc81bfbe56f7d, entries=1, sequenceid=41, filesize=4.9 K 2023-11-11 04:55:52,724 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a36cd15569ca04bc0fc71a10e86f004a in 825ms, sequenceid=41, compaction requested=true 2023-11-11 04:55:52,724 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:52,724 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:52,724 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 04:55:52,724 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 04:55:52,724 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,724 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 04:55:52,724 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 04:55:52,726 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,726 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:52,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:52,727 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,727 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:52,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 04:55:52,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16254834[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:52,728 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 04:55:52,728 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,729 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,729 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 04:55:52,729 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 04:55:52,729 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:52,730 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,730 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:52,731 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 04:55:52,731 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:52,731 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,731 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 04:55:52,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:52,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:52,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:52,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:52,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:52,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:52,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 04:55:52,733 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 04:55:52,733 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:52,733 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:52,733 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,733 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:52,735 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,735 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:52,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,735 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:52,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:52,735 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,736 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:52,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,739 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,739 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,739 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:52,739 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,739 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:52,739 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:52,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 04:55:52,739 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:52,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:52,740 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 04:55:52,740 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:52,740 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:52,740 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,740 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:52,740 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:52,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:52,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:52,840 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:52,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:52,842 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-11 04:55:52,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:55:52,844 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:55:52,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:55:52,844 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679152844 2023-11-11 04:55:52,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 04:55:52,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-11 04:55:52,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:55:52,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x12a64e9b to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:55:52,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@354b50ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:55:52,851 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:55:53,285 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033c3b2e9957e4497abc5d09becb0594ca to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033c3b2e9957e4497abc5d09becb0594ca 2023-11-11 04:55:53,286 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:55:53,306 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:55:53,308 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:55:53,313 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:55:53,313 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:55:53,321 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/57df0e038c5042b5a8700fdbb15bc74f first=Optional[r5] last=Optional[r6] 2023-11-11 04:55:53,322 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/57df0e038c5042b5a8700fdbb15bc74f}] 2023-11-11 04:55:53,327 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/57df0e038c5042b5a8700fdbb15bc74f for inclusion in a36cd15569ca04bc0fc71a10e86f004a/family1 2023-11-11 04:55:53,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-11 04:55:53,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:55:53,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:53,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/57df0e038c5042b5a8700fdbb15bc74f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f3ded1rqvedjgmfk7vfgte8lc60cn4k0djjk8q5475jg6s93s4uc6a45fdhtfloj/family1/57df0e038c5042b5a8700fdbb15bc74f 2023-11-11 04:55:53,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f3ded1rqvedjgmfk7vfgte8lc60cn4k0djjk8q5475jg6s93s4uc6a45fdhtfloj/family1/57df0e038c5042b5a8700fdbb15bc74f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2088e399fc6b46f39cfd65fe671a731b_SeqId_44_ 2023-11-11 04:55:53,331 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f3ded1rqvedjgmfk7vfgte8lc60cn4k0djjk8q5475jg6s93s4uc6a45fdhtfloj/family1/57df0e038c5042b5a8700fdbb15bc74f into a36cd15569ca04bc0fc71a10e86f004a/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2088e399fc6b46f39cfd65fe671a731b_SeqId_44_ - updating store file list. 2023-11-11 04:55:53,334 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2088e399fc6b46f39cfd65fe671a731b_SeqId_44_ into a36cd15569ca04bc0fc71a10e86f004a/family1 2023-11-11 04:55:53,334 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f3ded1rqvedjgmfk7vfgte8lc60cn4k0djjk8q5475jg6s93s4uc6a45fdhtfloj/family1/57df0e038c5042b5a8700fdbb15bc74f into a36cd15569ca04bc0fc71a10e86f004a/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2088e399fc6b46f39cfd65fe671a731b_SeqId_44_) 2023-11-11 04:55:53,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f3ded1rqvedjgmfk7vfgte8lc60cn4k0djjk8q5475jg6s93s4uc6a45fdhtfloj/family1/57df0e038c5042b5a8700fdbb15bc74f 2023-11-11 04:55:53,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 04:55:53,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 04:55:53,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(1912): a36cd15569ca04bc0fc71a10e86f004a/family1 is initiating minor compaction 2023-11-11 04:55:53,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5277975a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:55:53,337 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of a36cd15569ca04bc0fc71a10e86f004a/family1 in testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:55:53,337 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/52f7da292abb4d7bafbc96cf2b650738, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/43650124ae9d47bb90327e6c59f36de5, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2fe3e936b12845a0952869d52d8bc966, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/3837db0bcc264945abbb7c617b86130d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/0c01a3a795b84861966d98abca86677e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/af98fdd66fbd4489853cfae16b225537, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/a6d9a40aa5fb4bc09dadb76b2f7c4d21, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/ca1d7c9ee3c94d0b8616e63aee1c4b31, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/4fe8a2bb170a4dad9a2dc81bfbe56f7d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2088e399fc6b46f39cfd65fe671a731b_SeqId_44_] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp, totalSize=49.7 K 2023-11-11 04:55:53,337 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 52f7da292abb4d7bafbc96cf2b650738, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 04:55:53,337 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 43650124ae9d47bb90327e6c59f36de5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 04:55:53,337 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 2fe3e936b12845a0952869d52d8bc966, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 04:55:53,337 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 3837db0bcc264945abbb7c617b86130d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 04:55:53,337 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 0c01a3a795b84861966d98abca86677e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 04:55:53,337 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting af98fdd66fbd4489853cfae16b225537, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 04:55:53,338 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting a6d9a40aa5fb4bc09dadb76b2f7c4d21, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 04:55:53,338 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting ca1d7c9ee3c94d0b8616e63aee1c4b31, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 04:55:53,338 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 4fe8a2bb170a4dad9a2dc81bfbe56f7d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 04:55:53,338 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] compactions.Compactor(207): Compacting 2088e399fc6b46f39cfd65fe671a731b_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 04:55:53,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:55:53,340 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:53,341 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b971868900c74144b95f5f3db10e734e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b971868900c74144b95f5f3db10e734e 2023-11-11 04:55:53,342 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601030c88ac47a14048629f74fb56764976ad to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601030c88ac47a14048629f74fb56764976ad 2023-11-11 04:55:53,342 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-11 04:55:53,342 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-11 04:55:53,343 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:55:53,343 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:55:53,369 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] throttle.PressureAwareThroughputController(145): a36cd15569ca04bc0fc71a10e86f004a#family1#compaction#166 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-11 04:55:53,394 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310e0f4eb27de143068be9ca5560109d67 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512310e0f4eb27de143068be9ca5560109d67 2023-11-11 04:55:53,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:55:53,418 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1a48285974a5445a8c16a6c9ec8ad669 first=Optional[r1] last=Optional[r4] 2023-11-11 04:55:53,419 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1a48285974a5445a8c16a6c9ec8ad669}] 2023-11-11 04:55:53,421 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1a48285974a5445a8c16a6c9ec8ad669 for inclusion in a36cd15569ca04bc0fc71a10e86f004a/family1 2023-11-11 04:55:53,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-11 04:55:53,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:55:53,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:53,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1a48285974a5445a8c16a6c9ec8ad669 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f0kcden8fogb8gn324jla5d83bks8tt3hj0ug8ubkejq5a4kvp1425gqk1aqg9su/family1/1a48285974a5445a8c16a6c9ec8ad669 2023-11-11 04:55:53,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f0kcden8fogb8gn324jla5d83bks8tt3hj0ug8ubkejq5a4kvp1425gqk1aqg9su/family1/1a48285974a5445a8c16a6c9ec8ad669 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/9e0cab37aa904558851fc64a53dfec26_SeqId_46_ 2023-11-11 04:55:53,427 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f0kcden8fogb8gn324jla5d83bks8tt3hj0ug8ubkejq5a4kvp1425gqk1aqg9su/family1/1a48285974a5445a8c16a6c9ec8ad669 into a36cd15569ca04bc0fc71a10e86f004a/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/9e0cab37aa904558851fc64a53dfec26_SeqId_46_ - updating store file list. 2023-11-11 04:55:53,429 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/9e0cab37aa904558851fc64a53dfec26_SeqId_46_ into a36cd15569ca04bc0fc71a10e86f004a/family1 2023-11-11 04:55:53,430 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f0kcden8fogb8gn324jla5d83bks8tt3hj0ug8ubkejq5a4kvp1425gqk1aqg9su/family1/1a48285974a5445a8c16a6c9ec8ad669 into a36cd15569ca04bc0fc71a10e86f004a/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/9e0cab37aa904558851fc64a53dfec26_SeqId_46_) 2023-11-11 04:55:53,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f0kcden8fogb8gn324jla5d83bks8tt3hj0ug8ubkejq5a4kvp1425gqk1aqg9su/family1/1a48285974a5445a8c16a6c9ec8ad669 2023-11-11 04:55:53,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:55:53,432 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:53,434 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512019cf4ebcba1c849d99cf507f1836503d0 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512019cf4ebcba1c849d99cf507f1836503d0 2023-11-11 04:55:53,435 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512053e68a56c44084f5e98b22bfc01f507fb to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512053e68a56c44084f5e98b22bfc01f507fb 2023-11-11 04:55:53,436 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228a5e322a74bc54e679a2c4d075e82ef62 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228a5e322a74bc54e679a2c4d075e82ef62 2023-11-11 04:55:53,437 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512315e31e6f1b2c84ae5a00afe0a0ae9a11c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512315e31e6f1b2c84ae5a00afe0a0ae9a11c 2023-11-11 04:55:53,437 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-11 04:55:53,437 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-11 04:55:53,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:55:53,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:55:53,875 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511302dd9e5877332451cbb7b811b1cfd1f70 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511302dd9e5877332451cbb7b811b1cfd1f70 2023-11-11 04:55:53,875 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:55:53,897 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a6eedf889c9b47129c823629a5390794 first=Optional[r00] last=Optional[r8] 2023-11-11 04:55:53,897 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a6eedf889c9b47129c823629a5390794}] 2023-11-11 04:55:53,899 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a6eedf889c9b47129c823629a5390794 for inclusion in a36cd15569ca04bc0fc71a10e86f004a/family1 2023-11-11 04:55:53,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-11 04:55:53,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 04:55:53,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:53,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a6eedf889c9b47129c823629a5390794 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6ie1qu8khkhorijtllcq9mgm43bvpq8irsomf82k6bj127r05v7ql8ia8l63ihke/family1/a6eedf889c9b47129c823629a5390794 2023-11-11 04:55:53,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6ie1qu8khkhorijtllcq9mgm43bvpq8irsomf82k6bj127r05v7ql8ia8l63ihke/family1/a6eedf889c9b47129c823629a5390794 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/0febe3fa3af5406781c5e35168d5918c_SeqId_48_ 2023-11-11 04:55:53,904 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6ie1qu8khkhorijtllcq9mgm43bvpq8irsomf82k6bj127r05v7ql8ia8l63ihke/family1/a6eedf889c9b47129c823629a5390794 into a36cd15569ca04bc0fc71a10e86f004a/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/0febe3fa3af5406781c5e35168d5918c_SeqId_48_ - updating store file list. 2023-11-11 04:55:53,907 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/0febe3fa3af5406781c5e35168d5918c_SeqId_48_ into a36cd15569ca04bc0fc71a10e86f004a/family1 2023-11-11 04:55:53,907 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6ie1qu8khkhorijtllcq9mgm43bvpq8irsomf82k6bj127r05v7ql8ia8l63ihke/family1/a6eedf889c9b47129c823629a5390794 into a36cd15569ca04bc0fc71a10e86f004a/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/0febe3fa3af5406781c5e35168d5918c_SeqId_48_) 2023-11-11 04:55:53,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6ie1qu8khkhorijtllcq9mgm43bvpq8irsomf82k6bj127r05v7ql8ia8l63ihke/family1/a6eedf889c9b47129c823629a5390794 2023-11-11 04:55:53,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] compactions.SortedCompactionPolicy(75): Selecting compaction from 13 store files, 10 compacting, 2 eligible, 16 blocking 2023-11-11 04:55:53,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-11 04:55:53,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-11 04:55:53,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.CompactSplit(415): Not compacting testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. because compaction request was cancelled 2023-11-11 04:55:53,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:55:53,910 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:53,912 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120542f641ff6804476a2857a84ba9939e8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120542f641ff6804476a2857a84ba9939e8 2023-11-11 04:55:53,912 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112829e956dc7cfc4d648cf783b718c63bd0 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112829e956dc7cfc4d648cf783b718c63bd0 2023-11-11 04:55:53,913 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113026725564af58417bbe06a4cd7d3efcbc to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113026725564af58417bbe06a4cd7d3efcbc 2023-11-11 04:55:53,913 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-11 04:55:53,913 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-11 04:55:53,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:55:53,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:55:53,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 04:55:53,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 04:55:53,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:55:53,916 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 04:55:53,916 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.0740 sec 2023-11-11 04:55:54,131 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=264 (was 251) - Thread LEAK? -, OpenFileDescriptor=688 (was 658) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 204), ProcessCount=167 (was 167), AvailableMemoryMB=2397 (was 2402) 2023-11-11 04:55:54,142 INFO [Listener at localhost/35271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=264, OpenFileDescriptor=688, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=167, AvailableMemoryMB=2397 2023-11-11 04:55:54,162 DEBUG [Listener at localhost/35271] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-11 04:55:54,186 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/.tmp/family1/9574543ddd594120b457a0e71b0434b7 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/9574543ddd594120b457a0e71b0434b7 2023-11-11 04:55:54,190 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a36cd15569ca04bc0fc71a10e86f004a/family1 of a36cd15569ca04bc0fc71a10e86f004a into 9574543ddd594120b457a0e71b0434b7(size=6.6 K), total size for store is 344.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:55:54,190 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:55:54,191 INFO [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699678553337; duration=0sec 2023-11-11 04:55:54,191 DEBUG [RS:0;jenkins-hbase4:43941-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 04:55:54,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/52f7da292abb4d7bafbc96cf2b650738, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/43650124ae9d47bb90327e6c59f36de5, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2fe3e936b12845a0952869d52d8bc966, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/3837db0bcc264945abbb7c617b86130d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/0c01a3a795b84861966d98abca86677e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/af98fdd66fbd4489853cfae16b225537, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/a6d9a40aa5fb4bc09dadb76b2f7c4d21, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/ca1d7c9ee3c94d0b8616e63aee1c4b31, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/4fe8a2bb170a4dad9a2dc81bfbe56f7d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2088e399fc6b46f39cfd65fe671a731b_SeqId_44_] to archive 2023-11-11 04:55:54,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:55:54,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/52f7da292abb4d7bafbc96cf2b650738 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/52f7da292abb4d7bafbc96cf2b650738 2023-11-11 04:55:54,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/43650124ae9d47bb90327e6c59f36de5 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/43650124ae9d47bb90327e6c59f36de5 2023-11-11 04:55:54,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2fe3e936b12845a0952869d52d8bc966 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2fe3e936b12845a0952869d52d8bc966 2023-11-11 04:55:54,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/3837db0bcc264945abbb7c617b86130d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/3837db0bcc264945abbb7c617b86130d 2023-11-11 04:55:54,209 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/0c01a3a795b84861966d98abca86677e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/0c01a3a795b84861966d98abca86677e 2023-11-11 04:55:54,210 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/af98fdd66fbd4489853cfae16b225537 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/af98fdd66fbd4489853cfae16b225537 2023-11-11 04:55:54,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/a6d9a40aa5fb4bc09dadb76b2f7c4d21 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/a6d9a40aa5fb4bc09dadb76b2f7c4d21 2023-11-11 04:55:54,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/ca1d7c9ee3c94d0b8616e63aee1c4b31 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/ca1d7c9ee3c94d0b8616e63aee1c4b31 2023-11-11 04:55:54,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/4fe8a2bb170a4dad9a2dc81bfbe56f7d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/4fe8a2bb170a4dad9a2dc81bfbe56f7d 2023-11-11 04:55:54,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2088e399fc6b46f39cfd65fe671a731b_SeqId_44_ to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/family1/2088e399fc6b46f39cfd65fe671a731b_SeqId_44_ 2023-11-11 04:55:54,220 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10(D\xFFl\xC3\xEE\xE2\x09\xBEe\xDA\x9Ar=\xFEz"\x10!us\xE8\x1F\xA2k\x15[Y|\x12\xC90Ek*\x10\x110\xC9\xAF\x08C\xE4\x9E=&%\xD2@\x1EYo2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-11 04:55:54,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-11 04:55:54,222 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 04:55:54,222 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-11 04:55:54,222 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 04:55:54,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 04:55:54,224 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb 2023-11-11 04:55:54,224 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d 2023-11-11 04:55:54,224 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca 2023-11-11 04:55:54,225 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb empty. 2023-11-11 04:55:54,225 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca empty. 2023-11-11 04:55:54,225 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d empty. 2023-11-11 04:55:54,225 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb 2023-11-11 04:55:54,225 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca 2023-11-11 04:55:54,225 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d 2023-11-11 04:55:54,225 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-11 04:55:54,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 04:55:54,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 04:55:54,632 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-11 04:55:54,633 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 41418b6d675c8b4704b8e00a27d091fb, NAME => 'testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10(D\xFFl\xC3\xEE\xE2\x09\xBEe\xDA\x9Ar=\xFEz"\x10!us\xE8\x1F\xA2k\x15[Y|\x12\xC90Ek*\x10\x110\xC9\xAF\x08C\xE4\x9E=&%\xD2@\x1EYo2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:55:54,634 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 03fa52e8eef4e3b415e3c16f3fbf695d, NAME => 'testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10(D\xFFl\xC3\xEE\xE2\x09\xBEe\xDA\x9Ar=\xFEz"\x10!us\xE8\x1F\xA2k\x15[Y|\x12\xC90Ek*\x10\x110\xC9\xAF\x08C\xE4\x9E=&%\xD2@\x1EYo2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:55:54,634 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 94b83d298105b4a0a2b7001a2ac465ca, NAME => 'testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10(D\xFFl\xC3\xEE\xE2\x09\xBEe\xDA\x9Ar=\xFEz"\x10!us\xE8\x1F\xA2k\x15[Y|\x12\xC90Ek*\x10\x110\xC9\xAF\x08C\xE4\x9E=&%\xD2@\x1EYo2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/.tmp 2023-11-11 04:55:54,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 04:55:55,041 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:55,041 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:55,041 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 03fa52e8eef4e3b415e3c16f3fbf695d, disabling compactions & flushes 2023-11-11 04:55:55,041 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 94b83d298105b4a0a2b7001a2ac465ca, disabling compactions & flushes 2023-11-11 04:55:55,041 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:55,041 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:55,041 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:55,041 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. after waiting 0 ms 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. after waiting 0 ms 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:55,042 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 94b83d298105b4a0a2b7001a2ac465ca: 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:55,042 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 03fa52e8eef4e3b415e3c16f3fbf695d: 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 41418b6d675c8b4704b8e00a27d091fb, disabling compactions & flushes 2023-11-11 04:55:55,042 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. after waiting 0 ms 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:55,042 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:55,042 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 41418b6d675c8b4704b8e00a27d091fb: 2023-11-11 04:55:55,044 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 04:55:55,045 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678555045"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678555045"}]},"ts":"1699678555045"} 2023-11-11 04:55:55,045 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699678555045"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678555045"}]},"ts":"1699678555045"} 2023-11-11 04:55:55,045 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678555045"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699678555045"}]},"ts":"1699678555045"} 2023-11-11 04:55:55,047 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-11 04:55:55,047 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 04:55:55,048 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678555047"}]},"ts":"1699678555047"} 2023-11-11 04:55:55,048 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-11 04:55:55,051 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=41418b6d675c8b4704b8e00a27d091fb, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=03fa52e8eef4e3b415e3c16f3fbf695d, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=94b83d298105b4a0a2b7001a2ac465ca, ASSIGN}] 2023-11-11 04:55:55,053 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=94b83d298105b4a0a2b7001a2ac465ca, ASSIGN 2023-11-11 04:55:55,053 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=03fa52e8eef4e3b415e3c16f3fbf695d, ASSIGN 2023-11-11 04:55:55,053 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=41418b6d675c8b4704b8e00a27d091fb, ASSIGN 2023-11-11 04:55:55,053 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=94b83d298105b4a0a2b7001a2ac465ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:55:55,053 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=41418b6d675c8b4704b8e00a27d091fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:55:55,053 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=03fa52e8eef4e3b415e3c16f3fbf695d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43941,1699678403879; forceNewPlan=false, retain=false 2023-11-11 04:55:55,205 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=41418b6d675c8b4704b8e00a27d091fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:55,205 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=03fa52e8eef4e3b415e3c16f3fbf695d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:55,205 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678555205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678555205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678555205"}]},"ts":"1699678555205"} 2023-11-11 04:55:55,205 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=94b83d298105b4a0a2b7001a2ac465ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:55,205 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699678555205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678555205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678555205"}]},"ts":"1699678555205"} 2023-11-11 04:55:55,205 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678555205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699678555205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699678555205"}]},"ts":"1699678555205"} 2023-11-11 04:55:55,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 41418b6d675c8b4704b8e00a27d091fb, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:55,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 03fa52e8eef4e3b415e3c16f3fbf695d, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:55,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 94b83d298105b4a0a2b7001a2ac465ca, server=jenkins-hbase4.apache.org,43941,1699678403879}] 2023-11-11 04:55:55,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 04:55:55,358 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:55,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:55,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 03fa52e8eef4e3b415e3c16f3fbf695d, NAME => 'testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d.', STARTKEY => '1', ENDKEY => '2'} 2023-11-11 04:55:55,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 03fa52e8eef4e3b415e3c16f3fbf695d 2023-11-11 04:55:55,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:55,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 03fa52e8eef4e3b415e3c16f3fbf695d 2023-11-11 04:55:55,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 03fa52e8eef4e3b415e3c16f3fbf695d 2023-11-11 04:55:55,383 INFO [StoreOpener-03fa52e8eef4e3b415e3c16f3fbf695d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 03fa52e8eef4e3b415e3c16f3fbf695d 2023-11-11 04:55:55,384 DEBUG [StoreOpener-03fa52e8eef4e3b415e3c16f3fbf695d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1 2023-11-11 04:55:55,384 DEBUG [StoreOpener-03fa52e8eef4e3b415e3c16f3fbf695d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1 2023-11-11 04:55:55,385 INFO [StoreOpener-03fa52e8eef4e3b415e3c16f3fbf695d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03fa52e8eef4e3b415e3c16f3fbf695d columnFamilyName family1 2023-11-11 04:55:55,386 INFO [StoreOpener-03fa52e8eef4e3b415e3c16f3fbf695d-1] regionserver.HStore(310): Store=03fa52e8eef4e3b415e3c16f3fbf695d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:55,386 INFO [StoreOpener-03fa52e8eef4e3b415e3c16f3fbf695d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 03fa52e8eef4e3b415e3c16f3fbf695d 2023-11-11 04:55:55,387 DEBUG [StoreOpener-03fa52e8eef4e3b415e3c16f3fbf695d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2 2023-11-11 04:55:55,387 DEBUG [StoreOpener-03fa52e8eef4e3b415e3c16f3fbf695d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2 2023-11-11 04:55:55,387 INFO [StoreOpener-03fa52e8eef4e3b415e3c16f3fbf695d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03fa52e8eef4e3b415e3c16f3fbf695d columnFamilyName family2 2023-11-11 04:55:55,388 INFO [StoreOpener-03fa52e8eef4e3b415e3c16f3fbf695d-1] regionserver.HStore(310): Store=03fa52e8eef4e3b415e3c16f3fbf695d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:55,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d 2023-11-11 04:55:55,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d 2023-11-11 04:55:55,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:55,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 03fa52e8eef4e3b415e3c16f3fbf695d 2023-11-11 04:55:55,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:55:55,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 03fa52e8eef4e3b415e3c16f3fbf695d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72725152, jitterRate=0.08368921279907227}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:55,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 03fa52e8eef4e3b415e3c16f3fbf695d: 2023-11-11 04:55:55,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d., pid=121, masterSystemTime=1699678555358 2023-11-11 04:55:55,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:55,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:55,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:55,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 41418b6d675c8b4704b8e00a27d091fb, NAME => 'testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb.', STARTKEY => '', ENDKEY => '1'} 2023-11-11 04:55:55,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 41418b6d675c8b4704b8e00a27d091fb 2023-11-11 04:55:55,395 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=03fa52e8eef4e3b415e3c16f3fbf695d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:55,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:55,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 41418b6d675c8b4704b8e00a27d091fb 2023-11-11 04:55:55,396 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699678555395"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678555395"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678555395"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678555395"}]},"ts":"1699678555395"} 2023-11-11 04:55:55,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 41418b6d675c8b4704b8e00a27d091fb 2023-11-11 04:55:55,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=118 2023-11-11 04:55:55,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 03fa52e8eef4e3b415e3c16f3fbf695d, server=jenkins-hbase4.apache.org,43941,1699678403879 in 190 msec 2023-11-11 04:55:55,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=03fa52e8eef4e3b415e3c16f3fbf695d, ASSIGN in 347 msec 2023-11-11 04:55:55,416 INFO [StoreOpener-41418b6d675c8b4704b8e00a27d091fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 41418b6d675c8b4704b8e00a27d091fb 2023-11-11 04:55:55,417 DEBUG [StoreOpener-41418b6d675c8b4704b8e00a27d091fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1 2023-11-11 04:55:55,417 DEBUG [StoreOpener-41418b6d675c8b4704b8e00a27d091fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1 2023-11-11 04:55:55,417 INFO [StoreOpener-41418b6d675c8b4704b8e00a27d091fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41418b6d675c8b4704b8e00a27d091fb columnFamilyName family1 2023-11-11 04:55:55,418 INFO [StoreOpener-41418b6d675c8b4704b8e00a27d091fb-1] regionserver.HStore(310): Store=41418b6d675c8b4704b8e00a27d091fb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:55,418 INFO [StoreOpener-41418b6d675c8b4704b8e00a27d091fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 41418b6d675c8b4704b8e00a27d091fb 2023-11-11 04:55:55,419 DEBUG [StoreOpener-41418b6d675c8b4704b8e00a27d091fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2 2023-11-11 04:55:55,419 DEBUG [StoreOpener-41418b6d675c8b4704b8e00a27d091fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2 2023-11-11 04:55:55,419 INFO [StoreOpener-41418b6d675c8b4704b8e00a27d091fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41418b6d675c8b4704b8e00a27d091fb columnFamilyName family2 2023-11-11 04:55:55,420 INFO [StoreOpener-41418b6d675c8b4704b8e00a27d091fb-1] regionserver.HStore(310): Store=41418b6d675c8b4704b8e00a27d091fb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:55,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb 2023-11-11 04:55:55,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb 2023-11-11 04:55:55,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:55,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 41418b6d675c8b4704b8e00a27d091fb 2023-11-11 04:55:55,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:55:55,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 41418b6d675c8b4704b8e00a27d091fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61385393, jitterRate=-0.08528636395931244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:55,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 41418b6d675c8b4704b8e00a27d091fb: 2023-11-11 04:55:55,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb., pid=120, masterSystemTime=1699678555358 2023-11-11 04:55:55,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:55,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:55,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:55,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 94b83d298105b4a0a2b7001a2ac465ca, NAME => 'testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca.', STARTKEY => '2', ENDKEY => ''} 2023-11-11 04:55:55,426 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=41418b6d675c8b4704b8e00a27d091fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:55,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 94b83d298105b4a0a2b7001a2ac465ca 2023-11-11 04:55:55,427 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678555426"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678555426"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678555426"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678555426"}]},"ts":"1699678555426"} 2023-11-11 04:55:55,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 04:55:55,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 94b83d298105b4a0a2b7001a2ac465ca 2023-11-11 04:55:55,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 94b83d298105b4a0a2b7001a2ac465ca 2023-11-11 04:55:55,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=117 2023-11-11 04:55:55,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 41418b6d675c8b4704b8e00a27d091fb, server=jenkins-hbase4.apache.org,43941,1699678403879 in 221 msec 2023-11-11 04:55:55,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=41418b6d675c8b4704b8e00a27d091fb, ASSIGN in 378 msec 2023-11-11 04:55:55,449 INFO [StoreOpener-94b83d298105b4a0a2b7001a2ac465ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 94b83d298105b4a0a2b7001a2ac465ca 2023-11-11 04:55:55,450 DEBUG [StoreOpener-94b83d298105b4a0a2b7001a2ac465ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1 2023-11-11 04:55:55,450 DEBUG [StoreOpener-94b83d298105b4a0a2b7001a2ac465ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1 2023-11-11 04:55:55,450 INFO [StoreOpener-94b83d298105b4a0a2b7001a2ac465ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94b83d298105b4a0a2b7001a2ac465ca columnFamilyName family1 2023-11-11 04:55:55,451 INFO [StoreOpener-94b83d298105b4a0a2b7001a2ac465ca-1] regionserver.HStore(310): Store=94b83d298105b4a0a2b7001a2ac465ca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:55,451 INFO [StoreOpener-94b83d298105b4a0a2b7001a2ac465ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 94b83d298105b4a0a2b7001a2ac465ca 2023-11-11 04:55:55,452 DEBUG [StoreOpener-94b83d298105b4a0a2b7001a2ac465ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2 2023-11-11 04:55:55,452 DEBUG [StoreOpener-94b83d298105b4a0a2b7001a2ac465ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2 2023-11-11 04:55:55,452 INFO [StoreOpener-94b83d298105b4a0a2b7001a2ac465ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94b83d298105b4a0a2b7001a2ac465ca columnFamilyName family2 2023-11-11 04:55:55,453 INFO [StoreOpener-94b83d298105b4a0a2b7001a2ac465ca-1] regionserver.HStore(310): Store=94b83d298105b4a0a2b7001a2ac465ca/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 04:55:55,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca 2023-11-11 04:55:55,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca 2023-11-11 04:55:55,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 04:55:55,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 94b83d298105b4a0a2b7001a2ac465ca 2023-11-11 04:55:55,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 04:55:55,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 94b83d298105b4a0a2b7001a2ac465ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73588316, jitterRate=0.09655135869979858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 04:55:55,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 94b83d298105b4a0a2b7001a2ac465ca: 2023-11-11 04:55:55,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca., pid=122, masterSystemTime=1699678555358 2023-11-11 04:55:55,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:55,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:55,459 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=94b83d298105b4a0a2b7001a2ac465ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:55,459 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699678555459"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699678555459"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699678555459"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699678555459"}]},"ts":"1699678555459"} 2023-11-11 04:55:55,461 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=119 2023-11-11 04:55:55,461 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 94b83d298105b4a0a2b7001a2ac465ca, server=jenkins-hbase4.apache.org,43941,1699678403879 in 252 msec 2023-11-11 04:55:55,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=119, resume processing ppid=116 2023-11-11 04:55:55,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=94b83d298105b4a0a2b7001a2ac465ca, ASSIGN in 410 msec 2023-11-11 04:55:55,463 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 04:55:55,463 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699678555463"}]},"ts":"1699678555463"} 2023-11-11 04:55:55,464 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-11 04:55:55,466 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 04:55:55,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2460 sec 2023-11-11 04:55:55,593 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-11 04:55:56,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 04:55:56,328 INFO [Listener at localhost/35271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-11 04:55:56,334 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:56,334 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:56,334 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:56,336 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:56,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-11 04:55:56,337 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-11 04:55:56,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:56,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-11 04:55:56,337 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-11 04:55:56,338 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:56,338 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:56,340 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:56,340 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:56,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:56,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:56,340 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:56,340 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:56,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:56,341 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-11 04:55:56,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-11 04:55:56,341 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-11 04:55:56,341 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:56,342 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-11 04:55:56,342 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:56,342 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. started... 2023-11-11 04:55:56,342 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:56,342 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:56,343 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:56,342 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. started... 2023-11-11 04:55:56,343 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:56,343 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94b83d298105b4a0a2b7001a2ac465ca 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 04:55:56,343 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. started... 2023-11-11 04:55:56,343 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 41418b6d675c8b4704b8e00a27d091fb 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 04:55:56,344 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 03fa52e8eef4e3b415e3c16f3fbf695d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 04:55:56,789 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311114b56f8e620634279bc90710f4081b318 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311114b56f8e620634279bc90710f4081b318 2023-11-11 04:55:56,798 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311119e4cebf0a49046eea2769ddf6e25a211 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311119e4cebf0a49046eea2769ddf6e25a211 2023-11-11 04:55:56,800 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311110778bd5079e1494cb7ecafa7e3313a1e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311110778bd5079e1494cb7ecafa7e3313a1e 2023-11-11 04:55:56,806 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family1/6334ac5d84ae472e96eb0ef4ccef71a2 2023-11-11 04:55:56,814 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family1/e4e09013eb8142bd9567285f08ffb69d 2023-11-11 04:55:56,826 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family1/df9e7cae6f724d0d8cdfe23ec5f17b85 2023-11-11 04:55:56,859 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111141c245e35baf4ecdb3a89e430e3f1d17 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023111141c245e35baf4ecdb3a89e430e3f1d17 2023-11-11 04:55:56,866 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family2/928eb4a6387841fcbbe8d0c2f14c1668 2023-11-11 04:55:56,871 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family1/e4e09013eb8142bd9567285f08ffb69d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/e4e09013eb8142bd9567285f08ffb69d 2023-11-11 04:55:56,871 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311115030f219e726456f921d470a0010c1ca to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311115030f219e726456f921d470a0010c1ca 2023-11-11 04:55:56,880 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family2/16453a14d9014d4098a253e3bd7c3307 2023-11-11 04:55:56,886 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family1/df9e7cae6f724d0d8cdfe23ec5f17b85 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/df9e7cae6f724d0d8cdfe23ec5f17b85 2023-11-11 04:55:56,909 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/e4e09013eb8142bd9567285f08ffb69d, entries=4, sequenceid=5, filesize=5.5 K 2023-11-11 04:55:56,910 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family2/928eb4a6387841fcbbe8d0c2f14c1668 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/928eb4a6387841fcbbe8d0c2f14c1668 2023-11-11 04:55:56,910 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/df9e7cae6f724d0d8cdfe23ec5f17b85, entries=4, sequenceid=5, filesize=5.5 K 2023-11-11 04:55:56,911 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family2/16453a14d9014d4098a253e3bd7c3307 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/16453a14d9014d4098a253e3bd7c3307 2023-11-11 04:55:56,913 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/928eb4a6387841fcbbe8d0c2f14c1668, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 04:55:56,914 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/16453a14d9014d4098a253e3bd7c3307, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 04:55:56,914 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 94b83d298105b4a0a2b7001a2ac465ca in 571ms, sequenceid=5, compaction requested=false 2023-11-11 04:55:56,915 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94b83d298105b4a0a2b7001a2ac465ca: 2023-11-11 04:55:56,915 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:56,915 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:56,915 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 41418b6d675c8b4704b8e00a27d091fb in 572ms, sequenceid=5, compaction requested=false 2023-11-11 04:55:56,915 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 41418b6d675c8b4704b8e00a27d091fb: 2023-11-11 04:55:56,915 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:56,915 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:57,248 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311111a7dc73850ae4780b2539963ab4af81a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311111a7dc73850ae4780b2539963ab4af81a 2023-11-11 04:55:57,653 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family2/7c8909991e6f4b4185ba99d486b9fd56 2023-11-11 04:55:57,657 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family1/6334ac5d84ae472e96eb0ef4ccef71a2 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/6334ac5d84ae472e96eb0ef4ccef71a2 2023-11-11 04:55:57,681 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/6334ac5d84ae472e96eb0ef4ccef71a2, entries=4, sequenceid=5, filesize=5.5 K 2023-11-11 04:55:57,682 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family2/7c8909991e6f4b4185ba99d486b9fd56 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/7c8909991e6f4b4185ba99d486b9fd56 2023-11-11 04:55:57,685 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/7c8909991e6f4b4185ba99d486b9fd56, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 04:55:57,685 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 03fa52e8eef4e3b415e3c16f3fbf695d in 1341ms, sequenceid=5, compaction requested=false 2023-11-11 04:55:57,685 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 03fa52e8eef4e3b415e3c16f3fbf695d: 2023-11-11 04:55:57,685 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:57,685 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:57,686 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:57,686 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,686 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-11 04:55:57,686 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-11 04:55:57,687 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,687 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:57,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:57,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:57,688 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:57,688 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:57,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:57,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:57,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:57,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:57,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-11 04:55:57,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63633c60[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:57,689 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-11 04:55:57,689 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:57,691 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:57,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:57,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:57,691 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-11 04:55:57,691 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-11 04:55:57,691 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:57,691 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,691 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:57,692 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-11 04:55:57,692 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,692 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:57,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:57,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:57,692 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-11 04:55:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:57,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:57,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:57,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-11 04:55:57,695 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-11 04:55:57,695 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:57,695 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:57,695 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-11 04:55:57,695 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:57,700 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:57,700 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:57,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:57,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:57,700 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:57,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:57,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:57,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:57,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:57,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:57,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:57,701 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:57,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:57,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:57,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:57,702 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:57,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:57,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,705 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,705 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:57,705 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:57,705 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,705 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:57,705 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:57,705 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:57,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:57,705 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-11 04:55:57,705 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:57,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-11 04:55:57,705 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:57,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:57,705 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:57,705 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:57,705 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:57,705 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:57,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:57,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:57,806 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:57,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:57,807 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:57,807 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:57,808 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:57,810 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:57,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:57,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-11 04:55:57,812 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-11 04:55:57,812 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:57,812 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-11 04:55:57,812 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-11 04:55:57,812 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:57,812 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:57,813 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,814 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:57,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:57,814 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:57,814 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:57,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:57,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:57,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:57,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:57,815 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-11 04:55:57,815 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-11 04:55:57,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-11 04:55:57,815 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-11 04:55:57,815 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:57,815 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-11 04:55:57,815 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:57,816 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:57,816 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. started... 2023-11-11 04:55:57,816 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. started... 2023-11-11 04:55:57,816 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94b83d298105b4a0a2b7001a2ac465ca 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 04:55:57,816 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 41418b6d675c8b4704b8e00a27d091fb 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 04:55:57,817 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:57,817 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:57,817 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:57,817 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. started... 2023-11-11 04:55:57,817 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 03fa52e8eef4e3b415e3c16f3fbf695d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 04:55:57,868 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111178bb927e44d7469ca2880fe578ccacea to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111178bb927e44d7469ca2880fe578ccacea 2023-11-11 04:55:57,868 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111f4e48fbe8b6244c9926b0fa9e8cbfdcf to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231111f4e48fbe8b6244c9926b0fa9e8cbfdcf 2023-11-11 04:55:57,883 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family1/ebe1985fd46f424e8b25286c9bb855c8 2023-11-11 04:55:58,258 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111479f28036c8c4b91b0f9550c070ee812 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111479f28036c8c4b91b0f9550c070ee812 2023-11-11 04:55:58,283 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family1/f82fc82bca314f3f84698e496e147582 2023-11-11 04:55:58,322 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111d6a5eee8f9e7476fb1143e6d46ef2fb8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231111d6a5eee8f9e7476fb1143e6d46ef2fb8 2023-11-11 04:55:58,326 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111182a37efd7179451c81e938e1b0c1ab50 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023111182a37efd7179451c81e938e1b0c1ab50 2023-11-11 04:55:58,326 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family2/cc7449262b624cb982b515fd10fd82b4 2023-11-11 04:55:58,330 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family1/ebe1985fd46f424e8b25286c9bb855c8 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/ebe1985fd46f424e8b25286c9bb855c8 2023-11-11 04:55:58,354 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/ebe1985fd46f424e8b25286c9bb855c8, entries=4, sequenceid=9, filesize=5.5 K 2023-11-11 04:55:58,355 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family2/cc7449262b624cb982b515fd10fd82b4 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/cc7449262b624cb982b515fd10fd82b4 2023-11-11 04:55:58,358 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/cc7449262b624cb982b515fd10fd82b4, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 04:55:58,359 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 94b83d298105b4a0a2b7001a2ac465ca in 543ms, sequenceid=9, compaction requested=false 2023-11-11 04:55:58,359 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94b83d298105b4a0a2b7001a2ac465ca: 2023-11-11 04:55:58,359 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:58,359 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:55:58,673 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family1/0975ca1987414020b090f433efa404af 2023-11-11 04:55:58,734 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family2/2a9159fae445418cb09a006cd0f15679 2023-11-11 04:55:58,738 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family1/f82fc82bca314f3f84698e496e147582 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f82fc82bca314f3f84698e496e147582 2023-11-11 04:55:58,761 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f82fc82bca314f3f84698e496e147582, entries=4, sequenceid=9, filesize=5.5 K 2023-11-11 04:55:58,762 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family2/2a9159fae445418cb09a006cd0f15679 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2a9159fae445418cb09a006cd0f15679 2023-11-11 04:55:58,765 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2a9159fae445418cb09a006cd0f15679, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 04:55:58,766 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 03fa52e8eef4e3b415e3c16f3fbf695d in 949ms, sequenceid=9, compaction requested=false 2023-11-11 04:55:58,766 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 03fa52e8eef4e3b415e3c16f3fbf695d: 2023-11-11 04:55:58,766 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:58,766 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:55:59,108 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311114d9e900c87af489293647443bc2d6b29 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311114d9e900c87af489293647443bc2d6b29 2023-11-11 04:55:59,513 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family2/d80579b3813b4396b4f0e38dd51154d6 2023-11-11 04:55:59,517 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family1/0975ca1987414020b090f433efa404af as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/0975ca1987414020b090f433efa404af 2023-11-11 04:55:59,544 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/0975ca1987414020b090f433efa404af, entries=4, sequenceid=9, filesize=5.5 K 2023-11-11 04:55:59,545 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family2/d80579b3813b4396b4f0e38dd51154d6 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/d80579b3813b4396b4f0e38dd51154d6 2023-11-11 04:55:59,548 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/d80579b3813b4396b4f0e38dd51154d6, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 04:55:59,549 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 41418b6d675c8b4704b8e00a27d091fb in 1733ms, sequenceid=9, compaction requested=false 2023-11-11 04:55:59,549 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 41418b6d675c8b4704b8e00a27d091fb: 2023-11-11 04:55:59,549 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:59,549 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:55:59,549 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:55:59,549 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,549 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-11 04:55:59,549 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-11 04:55:59,551 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:59,551 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:59,551 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:59,551 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:55:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:59,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-11 04:55:59,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15b7583d[Count = 0] remaining members to acquire global barrier 2023-11-11 04:55:59,553 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-11 04:55:59,553 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:59,555 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:59,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:59,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:59,556 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-11 04:55:59,556 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-11 04:55:59,556 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:55:59,556 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,556 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:55:59,557 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-11 04:55:59,557 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,557 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:59,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:59,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:59,557 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-11 04:55:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:55:59,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-11 04:55:59,559 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-11 04:55:59,559 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:55:59,559 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:55:59,559 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-11 04:55:59,560 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:55:59,561 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:59,561 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:59,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:59,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:59,561 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:59,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:59,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:55:59,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:55:59,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:59,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:59,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:55:59,562 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:59,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:59,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:55:59,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:59,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,563 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:55:59,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:55:59,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,565 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,566 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:59,566 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:59,566 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:55:59,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:59,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:59,566 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:55:59,566 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-11 04:55:59,566 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:55:59,566 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:59,566 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,566 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:59,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:55:59,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:55:59,566 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-11 04:55:59,566 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:55:59,566 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:55:59,566 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:59,666 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:55:59,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:55:59,668 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:59,668 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:59,668 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:55:59,671 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:55:59,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-11 04:55:59,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-11 04:55:59,672 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-11 04:55:59,672 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:59,672 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-11 04:55:59,672 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-11 04:55:59,673 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:59,673 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:59,676 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:55:59,676 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:55:59,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:55:59,676 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:55:59,676 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:55:59,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:59,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:55:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:55:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:55:59,677 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-11 04:55:59,677 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-11 04:55:59,677 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-11 04:55:59,677 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-11 04:55:59,677 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:55:59,677 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-11 04:55:59,677 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:55:59,678 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. started... 2023-11-11 04:55:59,678 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:55:59,678 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:55:59,678 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:55:59,678 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:55:59,678 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. started... 2023-11-11 04:55:59,678 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. started... 2023-11-11 04:55:59,678 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94b83d298105b4a0a2b7001a2ac465ca 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 04:55:59,678 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 41418b6d675c8b4704b8e00a27d091fb 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 04:55:59,678 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 03fa52e8eef4e3b415e3c16f3fbf695d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 04:55:59,728 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111129df72b7d461456896e01e3d8d3b3dcf to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111129df72b7d461456896e01e3d8d3b3dcf 2023-11-11 04:55:59,729 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311113e65ee238256415b902fa5735adbadc0 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311113e65ee238256415b902fa5735adbadc0 2023-11-11 04:55:59,743 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family1/7bbe460e280b475cb7cc63d866ce159e 2023-11-11 04:56:00,120 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111b20688000bf446b3ae13ce4b039f9263 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111b20688000bf446b3ae13ce4b039f9263 2023-11-11 04:56:00,135 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family1/29b022fb79df4df49a0474128a901f1e 2023-11-11 04:56:00,144 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family1/c25b1833a1a44b899478868e3e5ff1e5 2023-11-11 04:56:00,175 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111e1fbc13207a640de8cb39c294b22a0fd to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231111e1fbc13207a640de8cb39c294b22a0fd 2023-11-11 04:56:00,178 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111a25df1c05fb04a359e776e1923ee86bd to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231111a25df1c05fb04a359e776e1923ee86bd 2023-11-11 04:56:00,193 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family2/c2e5645a72cf4356b218850d04d573b6 2023-11-11 04:56:00,197 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family1/29b022fb79df4df49a0474128a901f1e as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/29b022fb79df4df49a0474128a901f1e 2023-11-11 04:56:00,210 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111e5c791ee05c44ab991d3299e2c72d4a6 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231111e5c791ee05c44ab991d3299e2c72d4a6 2023-11-11 04:56:00,218 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family2/2efd1a30fa3245e0bc0b2c9d236af180 2023-11-11 04:56:00,224 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family1/c25b1833a1a44b899478868e3e5ff1e5 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/c25b1833a1a44b899478868e3e5ff1e5 2023-11-11 04:56:00,224 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/29b022fb79df4df49a0474128a901f1e, entries=4, sequenceid=13, filesize=5.5 K 2023-11-11 04:56:00,225 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family2/c2e5645a72cf4356b218850d04d573b6 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/c2e5645a72cf4356b218850d04d573b6 2023-11-11 04:56:00,231 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/c2e5645a72cf4356b218850d04d573b6, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 04:56:00,232 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 94b83d298105b4a0a2b7001a2ac465ca in 554ms, sequenceid=13, compaction requested=true 2023-11-11 04:56:00,232 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94b83d298105b4a0a2b7001a2ac465ca: 2023-11-11 04:56:00,233 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:00,233 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:56:00,248 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/c25b1833a1a44b899478868e3e5ff1e5, entries=4, sequenceid=13, filesize=5.5 K 2023-11-11 04:56:00,249 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family2/2efd1a30fa3245e0bc0b2c9d236af180 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2efd1a30fa3245e0bc0b2c9d236af180 2023-11-11 04:56:00,253 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2efd1a30fa3245e0bc0b2c9d236af180, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 04:56:00,253 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 03fa52e8eef4e3b415e3c16f3fbf695d in 575ms, sequenceid=13, compaction requested=true 2023-11-11 04:56:00,254 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 03fa52e8eef4e3b415e3c16f3fbf695d: 2023-11-11 04:56:00,254 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:00,254 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:56:00,591 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family2/c38edf74c9814b5f92e33bf3dd55b02a 2023-11-11 04:56:00,595 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family1/7bbe460e280b475cb7cc63d866ce159e as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/7bbe460e280b475cb7cc63d866ce159e 2023-11-11 04:56:00,618 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/7bbe460e280b475cb7cc63d866ce159e, entries=4, sequenceid=13, filesize=5.5 K 2023-11-11 04:56:00,618 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family2/c38edf74c9814b5f92e33bf3dd55b02a as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/c38edf74c9814b5f92e33bf3dd55b02a 2023-11-11 04:56:00,622 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/c38edf74c9814b5f92e33bf3dd55b02a, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 04:56:00,622 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 41418b6d675c8b4704b8e00a27d091fb in 944ms, sequenceid=13, compaction requested=true 2023-11-11 04:56:00,622 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 41418b6d675c8b4704b8e00a27d091fb: 2023-11-11 04:56:00,622 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:00,623 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:56:00,623 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:56:00,623 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,623 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-11 04:56:00,623 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-11 04:56:00,625 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:00,625 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:56:00,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:56:00,625 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:00,625 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:56:00,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:56:00,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:56:00,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:00,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:56:00,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-11 04:56:00,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ea3da67[Count = 0] remaining members to acquire global barrier 2023-11-11 04:56:00,627 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-11 04:56:00,627 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:00,629 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:00,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:00,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:00,629 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-11 04:56:00,629 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-11 04:56:00,629 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:56:00,629 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,629 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:56:00,631 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,631 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-11 04:56:00,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,631 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:56:00,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:56:00,631 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-11 04:56:00,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:56:00,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:56:00,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:56:00,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:00,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:56:00,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:00,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:56:00,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-11 04:56:00,634 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-11 04:56:00,634 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:56:00,634 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:56:00,634 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-11 04:56:00,634 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:56:00,636 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:00,636 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:00,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:00,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:00,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:56:00,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:56:00,636 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:56:00,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:00,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:56:00,636 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:56:00,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:56:00,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:00,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:00,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:56:00,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:00,638 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:56:00,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:00,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,641 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,641 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:00,641 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:56:00,641 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:00,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:56:00,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:56:00,641 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:56:00,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-11 04:56:00,641 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-11 04:56:00,641 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:56:00,641 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:56:00,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:56:00,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:56:00,641 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,641 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:00,641 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-11 04:56:00,641 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:00,641 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:56:00,642 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:00,742 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:56:00,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:56:00,743 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:56:00,744 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:56:00,744 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 04:56:00,746 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:56:00,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-11 04:56:00,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-11 04:56:00,748 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-11 04:56:00,748 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:56:00,748 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-11 04:56:00,748 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-11 04:56:00,748 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:00,748 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:00,751 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,751 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:56:00,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:56:00,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:56:00,751 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:00,751 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:56:00,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:00,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:00,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:56:00,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:00,752 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-11 04:56:00,752 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-11 04:56:00,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-11 04:56:00,752 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-11 04:56:00,752 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:56:00,752 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-11 04:56:00,752 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:00,753 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:56:00,753 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:56:00,753 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:00,753 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:00,753 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. started... 2023-11-11 04:56:00,753 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. started... 2023-11-11 04:56:00,753 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. started... 2023-11-11 04:56:00,753 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 41418b6d675c8b4704b8e00a27d091fb 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 04:56:00,753 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94b83d298105b4a0a2b7001a2ac465ca 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 04:56:00,753 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 03fa52e8eef4e3b415e3c16f3fbf695d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 04:56:00,799 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111e460cd5f8fc6489d93d94d6789e1d485 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111e460cd5f8fc6489d93d94d6789e1d485 2023-11-11 04:56:00,801 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111d47db1a9d05e4c56aafab997fd457120 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111d47db1a9d05e4c56aafab997fd457120 2023-11-11 04:56:00,802 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111feca1949111d488fbde106e688d39009 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231111feca1949111d488fbde106e688d39009 2023-11-11 04:56:00,819 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family1/6a21fe38bbb440e7a8a1bd617e2ec08f 2023-11-11 04:56:00,820 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family1/f71f2cac556346d3b0171084be599b1b 2023-11-11 04:56:00,862 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 04:56:00,921 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:56:00,921 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12a64e9b to 127.0.0.1:61842 2023-11-11 04:56:00,921 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:56:00,921 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:56:00,922 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x460c308f to 127.0.0.1:61842 2023-11-11 04:56:00,922 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:56:01,221 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family1/40d43ddcdfa94b47b5ff6b7d4be195bb 2023-11-11 04:56:01,275 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111be3872c4fcd240a6b34f8a1e4c4cf41c to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231111be3872c4fcd240a6b34f8a1e4c4cf41c 2023-11-11 04:56:01,275 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111e129c2434a2a416ab3aea678375af078 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231111e129c2434a2a416ab3aea678375af078 2023-11-11 04:56:01,654 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311113e6658f326824248a0ee46891c242fae to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311113e6658f326824248a0ee46891c242fae 2023-11-11 04:56:01,680 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family2/9b9b1558042e4ea9a4911a8daab70b0a 2023-11-11 04:56:01,680 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family2/627a1ae57b7f4dc4aacd59b6c55992a8 2023-11-11 04:56:01,683 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family1/f71f2cac556346d3b0171084be599b1b as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f71f2cac556346d3b0171084be599b1b 2023-11-11 04:56:01,684 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family1/6a21fe38bbb440e7a8a1bd617e2ec08f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/6a21fe38bbb440e7a8a1bd617e2ec08f 2023-11-11 04:56:01,707 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/6a21fe38bbb440e7a8a1bd617e2ec08f, entries=4, sequenceid=17, filesize=5.5 K 2023-11-11 04:56:01,707 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family2/627a1ae57b7f4dc4aacd59b6c55992a8 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/627a1ae57b7f4dc4aacd59b6c55992a8 2023-11-11 04:56:01,711 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/627a1ae57b7f4dc4aacd59b6c55992a8, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 04:56:01,711 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f71f2cac556346d3b0171084be599b1b, entries=4, sequenceid=17, filesize=5.5 K 2023-11-11 04:56:01,712 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 94b83d298105b4a0a2b7001a2ac465ca in 959ms, sequenceid=17, compaction requested=true 2023-11-11 04:56:01,712 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94b83d298105b4a0a2b7001a2ac465ca: 2023-11-11 04:56:01,712 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:01,712 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:56:01,713 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family2/9b9b1558042e4ea9a4911a8daab70b0a as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/9b9b1558042e4ea9a4911a8daab70b0a 2023-11-11 04:56:01,717 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/9b9b1558042e4ea9a4911a8daab70b0a, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 04:56:01,718 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 03fa52e8eef4e3b415e3c16f3fbf695d in 965ms, sequenceid=17, compaction requested=true 2023-11-11 04:56:01,718 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 03fa52e8eef4e3b415e3c16f3fbf695d: 2023-11-11 04:56:01,718 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:01,718 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:56:02,058 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family2/82bd4225b3114e43a45c397aafa242fd 2023-11-11 04:56:02,063 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family1/40d43ddcdfa94b47b5ff6b7d4be195bb as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/40d43ddcdfa94b47b5ff6b7d4be195bb 2023-11-11 04:56:02,086 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/40d43ddcdfa94b47b5ff6b7d4be195bb, entries=4, sequenceid=17, filesize=5.5 K 2023-11-11 04:56:02,086 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family2/82bd4225b3114e43a45c397aafa242fd as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/82bd4225b3114e43a45c397aafa242fd 2023-11-11 04:56:02,090 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/82bd4225b3114e43a45c397aafa242fd, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 04:56:02,091 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 41418b6d675c8b4704b8e00a27d091fb in 1338ms, sequenceid=17, compaction requested=true 2023-11-11 04:56:02,091 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 41418b6d675c8b4704b8e00a27d091fb: 2023-11-11 04:56:02,091 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:02,091 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:56:02,091 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:56:02,091 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,091 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-11 04:56:02,091 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-11 04:56:02,094 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,094 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:02,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:56:02,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:56:02,094 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:02,094 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:56:02,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:56:02,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:56:02,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:02,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:56:02,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-11 04:56:02,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@627b5d6f[Count = 0] remaining members to acquire global barrier 2023-11-11 04:56:02,096 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-11 04:56:02,096 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:02,101 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:02,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:02,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:02,101 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-11 04:56:02,101 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-11 04:56:02,101 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:56:02,101 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,101 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:56:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-11 04:56:02,102 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:56:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:56:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:56:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-11 04:56:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:56:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:56:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:02,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:56:02,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:02,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:56:02,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-11 04:56:02,105 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-11 04:56:02,105 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:56:02,105 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:56:02,105 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-11 04:56:02,105 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:56:02,106 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:02,106 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:02,106 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:56:02,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:56:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:56:02,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:56:02,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:56:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:56:02,107 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:02,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:56:02,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:02,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,108 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:56:02,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:02,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,110 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,110 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:02,110 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:02,110 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,110 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:02,110 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:56:02,110 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:56:02,110 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:02,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-11 04:56:02,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:56:02,110 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:56:02,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:56:02,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-11 04:56:02,111 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:56:02,111 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:02,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:56:02,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:56:02,111 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-11 04:56:02,111 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:56:02,211 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:56:02,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:56:02,220 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:56:02,226 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:56:02,234 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:56:02,235 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:56:02,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 04:56:02,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-11 04:56:02,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-11 04:56:02,320 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-11 04:56:02,320 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:56:02,320 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-11 04:56:02,320 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-11 04:56:02,321 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:02,321 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:02,323 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,323 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:56:02,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:56:02,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:56:02,323 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:02,323 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 04:56:02,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:02,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 04:56:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:02,324 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-11 04:56:02,324 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-11 04:56:02,324 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-11 04:56:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-11 04:56:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 04:56:02,324 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-11 04:56:02,328 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:02,328 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. started... 2023-11-11 04:56:02,328 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 04:56:02,328 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:02,328 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:02,328 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. started... 2023-11-11 04:56:02,328 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 94b83d298105b4a0a2b7001a2ac465ca 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 04:56:02,328 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 04:56:02,329 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 41418b6d675c8b4704b8e00a27d091fb 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 04:56:02,328 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. started... 2023-11-11 04:56:02,329 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 03fa52e8eef4e3b415e3c16f3fbf695d 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 04:56:02,363 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family1/4a87db42d7624737b633869b77fd563b 2023-11-11 04:56:02,369 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family1/599c6008c30c422389f98defb79b2a7d 2023-11-11 04:56:02,386 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a87db42d7624737b633869b77fd563b 2023-11-11 04:56:02,391 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 599c6008c30c422389f98defb79b2a7d 2023-11-11 04:56:02,410 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family2/82b383ff82534851a0c47e223e3f16ef 2023-11-11 04:56:02,413 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82b383ff82534851a0c47e223e3f16ef 2023-11-11 04:56:02,413 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family1/599c6008c30c422389f98defb79b2a7d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/599c6008c30c422389f98defb79b2a7d 2023-11-11 04:56:02,437 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 599c6008c30c422389f98defb79b2a7d 2023-11-11 04:56:02,437 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/599c6008c30c422389f98defb79b2a7d, entries=3, sequenceid=23, filesize=5.2 K 2023-11-11 04:56:02,438 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family2/82b383ff82534851a0c47e223e3f16ef as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/82b383ff82534851a0c47e223e3f16ef 2023-11-11 04:56:02,440 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82b383ff82534851a0c47e223e3f16ef 2023-11-11 04:56:02,440 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/82b383ff82534851a0c47e223e3f16ef, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 04:56:02,441 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 94b83d298105b4a0a2b7001a2ac465ca in 113ms, sequenceid=23, compaction requested=true 2023-11-11 04:56:02,441 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 94b83d298105b4a0a2b7001a2ac465ca: 2023-11-11 04:56:02,441 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:02,441 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 04:56:02,807 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family2/030a688fea4545278848e8e359ad3c55 2023-11-11 04:56:02,811 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 030a688fea4545278848e8e359ad3c55 2023-11-11 04:56:02,811 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family1/4a87db42d7624737b633869b77fd563b as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/4a87db42d7624737b633869b77fd563b 2023-11-11 04:56:02,835 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a87db42d7624737b633869b77fd563b 2023-11-11 04:56:02,835 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/4a87db42d7624737b633869b77fd563b, entries=3, sequenceid=23, filesize=5.2 K 2023-11-11 04:56:02,835 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family2/030a688fea4545278848e8e359ad3c55 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/030a688fea4545278848e8e359ad3c55 2023-11-11 04:56:02,839 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 030a688fea4545278848e8e359ad3c55 2023-11-11 04:56:02,839 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/030a688fea4545278848e8e359ad3c55, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 04:56:02,840 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 03fa52e8eef4e3b415e3c16f3fbf695d in 511ms, sequenceid=23, compaction requested=true 2023-11-11 04:56:02,840 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 03fa52e8eef4e3b415e3c16f3fbf695d: 2023-11-11 04:56:02,840 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:02,840 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 04:56:03,174 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family1/cc13e8412762499f8c47bdf31ded532f 2023-11-11 04:56:03,198 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc13e8412762499f8c47bdf31ded532f 2023-11-11 04:56:04,015 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family2/13898671fcd1447da3819d4b18369bd2 2023-11-11 04:56:04,019 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13898671fcd1447da3819d4b18369bd2 2023-11-11 04:56:04,019 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family1/cc13e8412762499f8c47bdf31ded532f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/cc13e8412762499f8c47bdf31ded532f 2023-11-11 04:56:04,042 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc13e8412762499f8c47bdf31ded532f 2023-11-11 04:56:04,042 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/cc13e8412762499f8c47bdf31ded532f, entries=3, sequenceid=23, filesize=5.2 K 2023-11-11 04:56:04,043 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family2/13898671fcd1447da3819d4b18369bd2 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/13898671fcd1447da3819d4b18369bd2 2023-11-11 04:56:04,046 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13898671fcd1447da3819d4b18369bd2 2023-11-11 04:56:04,046 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/13898671fcd1447da3819d4b18369bd2, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 04:56:04,046 INFO [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 41418b6d675c8b4704b8e00a27d091fb in 1717ms, sequenceid=23, compaction requested=true 2023-11-11 04:56:04,046 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 41418b6d675c8b4704b8e00a27d091fb: 2023-11-11 04:56:04,046 DEBUG [rs(jenkins-hbase4.apache.org,43941,1699678403879)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:04,046 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 04:56:04,047 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 04:56:04,047 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,047 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-11 04:56:04,047 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-11 04:56:04,048 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,048 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:04,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:56:04,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:56:04,049 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:04,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:56:04,049 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 04:56:04,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:56:04,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:56:04,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43941,1699678403879' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-11 04:56:04,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1801fd7c[Count = 0] remaining members to acquire global barrier 2023-11-11 04:56:04,050 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-11 04:56:04,050 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:04,051 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:04,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:04,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:04,052 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-11 04:56:04,052 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-11 04:56:04,052 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43941,1699678403879' in zk 2023-11-11 04:56:04,052 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,052 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 04:56:04,053 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,053 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-11 04:56:04,053 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:56:04,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:56:04,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:56:04,053 DEBUG [member: 'jenkins-hbase4.apache.org,43941,1699678403879' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-11 04:56:04,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:56:04,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:56:04,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:04,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:56:04,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:04,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43941,1699678403879': 2023-11-11 04:56:04,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43941,1699678403879' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-11 04:56:04,056 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-11 04:56:04,056 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 04:56:04,056 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 04:56:04,056 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-11 04:56:04,056 INFO [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 04:56:04,058 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:04,058 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:04,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:04,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:04,058 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:56:04,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:04,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 04:56:04,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 04:56:04,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:56:04,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:56:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 04:56:04,059 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 04:56:04,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:04,060 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 04:56:04,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 04:56:04,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,062 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 04:56:04,062 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 04:56:04,062 DEBUG [(jenkins-hbase4.apache.org,38667,1699678402647)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 04:56:04,062 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 04:56:04,062 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-11 04:56:04,062 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 04:56:04,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 04:56:04,062 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:04,062 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 04:56:04,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-11 04:56:04,062 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:04,062 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:04,063 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 04:56:04,063 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-11 04:56:04,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 04:56:04,063 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 04:56:04,063 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 04:56:04,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 04:56:04,163 DEBUG [Listener at localhost/35271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 04:56:04,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38667] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 04:56:04,164 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:56:04,164 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 94b83d298105b4a0a2b7001a2ac465ca/family1 is initiating major compaction (all files) 2023-11-11 04:56:04,164 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:56:04,164 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:56:04,164 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 94b83d298105b4a0a2b7001a2ac465ca/family1 in testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:04,164 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/e4e09013eb8142bd9567285f08ffb69d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/ebe1985fd46f424e8b25286c9bb855c8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/29b022fb79df4df49a0474128a901f1e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/6a21fe38bbb440e7a8a1bd617e2ec08f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/599c6008c30c422389f98defb79b2a7d] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp, totalSize=27.1 K 2023-11-11 04:56:04,165 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting e4e09013eb8142bd9567285f08ffb69d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678556334 2023-11-11 04:56:04,165 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting ebe1985fd46f424e8b25286c9bb855c8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678557808 2023-11-11 04:56:04,166 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 29b022fb79df4df49a0474128a901f1e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678559668 2023-11-11 04:56:04,166 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 6a21fe38bbb440e7a8a1bd617e2ec08f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678560744 2023-11-11 04:56:04,166 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 599c6008c30c422389f98defb79b2a7d, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:56:04,175 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 94b83d298105b4a0a2b7001a2ac465ca#family1#compaction#197 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:56:04,612 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111fafbc77d1a3a499388359599081c58ad_del 2023-11-11 04:56:04,612 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111fafbc77d1a3a499388359599081c58ad_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111fafbc77d1a3a499388359599081c58ad_del 2023-11-11 04:56:04,660 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a94fe2bc3ad4d429844f9a63538c258 2023-11-11 04:56:04,661 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family1/0a94fe2bc3ad4d429844f9a63538c258 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/0a94fe2bc3ad4d429844f9a63538c258 2023-11-11 04:56:04,685 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a94fe2bc3ad4d429844f9a63538c258 2023-11-11 04:56:04,686 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 94b83d298105b4a0a2b7001a2ac465ca/family1 of 94b83d298105b4a0a2b7001a2ac465ca into 0a94fe2bc3ad4d429844f9a63538c258(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:56:04,686 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 94b83d298105b4a0a2b7001a2ac465ca: 2023-11-11 04:56:04,686 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:56:04,686 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 94b83d298105b4a0a2b7001a2ac465ca/family2 is initiating major compaction (all files) 2023-11-11 04:56:04,686 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:56:04,686 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:56:04,687 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 94b83d298105b4a0a2b7001a2ac465ca/family2 in testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:04,687 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/928eb4a6387841fcbbe8d0c2f14c1668, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/cc7449262b624cb982b515fd10fd82b4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/c2e5645a72cf4356b218850d04d573b6, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/627a1ae57b7f4dc4aacd59b6c55992a8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/82b383ff82534851a0c47e223e3f16ef] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp, totalSize=25.4 K 2023-11-11 04:56:04,687 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 928eb4a6387841fcbbe8d0c2f14c1668, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678556334 2023-11-11 04:56:04,688 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting cc7449262b624cb982b515fd10fd82b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678557808 2023-11-11 04:56:04,688 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting c2e5645a72cf4356b218850d04d573b6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678559668 2023-11-11 04:56:04,688 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 627a1ae57b7f4dc4aacd59b6c55992a8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678560744 2023-11-11 04:56:04,689 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 82b383ff82534851a0c47e223e3f16ef, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:56:04,696 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 94b83d298105b4a0a2b7001a2ac465ca#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:56:04,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/e4e09013eb8142bd9567285f08ffb69d, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/ebe1985fd46f424e8b25286c9bb855c8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/29b022fb79df4df49a0474128a901f1e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/6a21fe38bbb440e7a8a1bd617e2ec08f, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/599c6008c30c422389f98defb79b2a7d] to archive 2023-11-11 04:56:04,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:04,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/e4e09013eb8142bd9567285f08ffb69d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/e4e09013eb8142bd9567285f08ffb69d 2023-11-11 04:56:04,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/ebe1985fd46f424e8b25286c9bb855c8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/ebe1985fd46f424e8b25286c9bb855c8 2023-11-11 04:56:04,703 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111aa27551ad3bd45918314af5959ec93a8_del 2023-11-11 04:56:04,703 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111aa27551ad3bd45918314af5959ec93a8_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231111aa27551ad3bd45918314af5959ec93a8_del 2023-11-11 04:56:04,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/29b022fb79df4df49a0474128a901f1e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/29b022fb79df4df49a0474128a901f1e 2023-11-11 04:56:04,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/6a21fe38bbb440e7a8a1bd617e2ec08f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/6a21fe38bbb440e7a8a1bd617e2ec08f 2023-11-11 04:56:04,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/599c6008c30c422389f98defb79b2a7d to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/599c6008c30c422389f98defb79b2a7d 2023-11-11 04:56:05,515 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0db002ec68c7480893a1b18c043e83f9 2023-11-11 04:56:05,516 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/.tmp/family2/0db002ec68c7480893a1b18c043e83f9 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/0db002ec68c7480893a1b18c043e83f9 2023-11-11 04:56:05,519 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0db002ec68c7480893a1b18c043e83f9 2023-11-11 04:56:05,520 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 94b83d298105b4a0a2b7001a2ac465ca/family2 of 94b83d298105b4a0a2b7001a2ac465ca into 0db002ec68c7480893a1b18c043e83f9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:56:05,520 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 94b83d298105b4a0a2b7001a2ac465ca: 2023-11-11 04:56:05,520 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:56:05,520 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 41418b6d675c8b4704b8e00a27d091fb/family1 is initiating major compaction (all files) 2023-11-11 04:56:05,520 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:56:05,520 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:56:05,522 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 41418b6d675c8b4704b8e00a27d091fb/family1 in testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:05,522 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/df9e7cae6f724d0d8cdfe23ec5f17b85, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/0975ca1987414020b090f433efa404af, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/7bbe460e280b475cb7cc63d866ce159e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/40d43ddcdfa94b47b5ff6b7d4be195bb, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/cc13e8412762499f8c47bdf31ded532f] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp, totalSize=27.1 K 2023-11-11 04:56:05,523 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting df9e7cae6f724d0d8cdfe23ec5f17b85, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678556333 2023-11-11 04:56:05,523 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 0975ca1987414020b090f433efa404af, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678557807 2023-11-11 04:56:05,523 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 7bbe460e280b475cb7cc63d866ce159e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678559668 2023-11-11 04:56:05,523 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 40d43ddcdfa94b47b5ff6b7d4be195bb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678560743 2023-11-11 04:56:05,523 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting cc13e8412762499f8c47bdf31ded532f, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:56:05,533 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 41418b6d675c8b4704b8e00a27d091fb#family1#compaction#199 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:56:05,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/928eb4a6387841fcbbe8d0c2f14c1668, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/cc7449262b624cb982b515fd10fd82b4, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/c2e5645a72cf4356b218850d04d573b6, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/627a1ae57b7f4dc4aacd59b6c55992a8, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/82b383ff82534851a0c47e223e3f16ef] to archive 2023-11-11 04:56:05,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:05,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/928eb4a6387841fcbbe8d0c2f14c1668 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/928eb4a6387841fcbbe8d0c2f14c1668 2023-11-11 04:56:05,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/cc7449262b624cb982b515fd10fd82b4 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/cc7449262b624cb982b515fd10fd82b4 2023-11-11 04:56:05,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/c2e5645a72cf4356b218850d04d573b6 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/c2e5645a72cf4356b218850d04d573b6 2023-11-11 04:56:05,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/627a1ae57b7f4dc4aacd59b6c55992a8 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/627a1ae57b7f4dc4aacd59b6c55992a8 2023-11-11 04:56:05,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/82b383ff82534851a0c47e223e3f16ef to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family2/82b383ff82534851a0c47e223e3f16ef 2023-11-11 04:56:05,970 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311114715d5fdb623441ba73c9e7f9fafa476_del 2023-11-11 04:56:05,970 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311114715d5fdb623441ba73c9e7f9fafa476_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311114715d5fdb623441ba73c9e7f9fafa476_del 2023-11-11 04:56:06,824 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00b68ca39f004df29f1a67412586537f 2023-11-11 04:56:06,825 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family1/00b68ca39f004df29f1a67412586537f as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/00b68ca39f004df29f1a67412586537f 2023-11-11 04:56:06,846 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00b68ca39f004df29f1a67412586537f 2023-11-11 04:56:06,847 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 41418b6d675c8b4704b8e00a27d091fb/family1 of 41418b6d675c8b4704b8e00a27d091fb into 00b68ca39f004df29f1a67412586537f(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:56:06,847 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 41418b6d675c8b4704b8e00a27d091fb: 2023-11-11 04:56:06,847 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:56:06,847 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 41418b6d675c8b4704b8e00a27d091fb/family2 is initiating major compaction (all files) 2023-11-11 04:56:06,848 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:56:06,848 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:56:06,848 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 41418b6d675c8b4704b8e00a27d091fb/family2 in testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:06,848 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/16453a14d9014d4098a253e3bd7c3307, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/d80579b3813b4396b4f0e38dd51154d6, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/c38edf74c9814b5f92e33bf3dd55b02a, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/82bd4225b3114e43a45c397aafa242fd, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/13898671fcd1447da3819d4b18369bd2] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp, totalSize=25.4 K 2023-11-11 04:56:06,849 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 16453a14d9014d4098a253e3bd7c3307, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678556333 2023-11-11 04:56:06,850 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting d80579b3813b4396b4f0e38dd51154d6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678557807 2023-11-11 04:56:06,850 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting c38edf74c9814b5f92e33bf3dd55b02a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678559668 2023-11-11 04:56:06,851 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 82bd4225b3114e43a45c397aafa242fd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678560743 2023-11-11 04:56:06,851 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 13898671fcd1447da3819d4b18369bd2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:56:06,858 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 41418b6d675c8b4704b8e00a27d091fb#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:56:06,898 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/df9e7cae6f724d0d8cdfe23ec5f17b85, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/0975ca1987414020b090f433efa404af, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/7bbe460e280b475cb7cc63d866ce159e, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/40d43ddcdfa94b47b5ff6b7d4be195bb, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/cc13e8412762499f8c47bdf31ded532f] to archive 2023-11-11 04:56:06,899 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:06,900 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/df9e7cae6f724d0d8cdfe23ec5f17b85 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/df9e7cae6f724d0d8cdfe23ec5f17b85 2023-11-11 04:56:06,901 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/0975ca1987414020b090f433efa404af to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/0975ca1987414020b090f433efa404af 2023-11-11 04:56:06,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/7bbe460e280b475cb7cc63d866ce159e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/7bbe460e280b475cb7cc63d866ce159e 2023-11-11 04:56:06,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/40d43ddcdfa94b47b5ff6b7d4be195bb to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/40d43ddcdfa94b47b5ff6b7d4be195bb 2023-11-11 04:56:06,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/cc13e8412762499f8c47bdf31ded532f to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/cc13e8412762499f8c47bdf31ded532f 2023-11-11 04:56:07,266 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231111efa7565d0f334c7eac3e827acc185cda_del 2023-11-11 04:56:07,266 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111efa7565d0f334c7eac3e827acc185cda_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231111efa7565d0f334c7eac3e827acc185cda_del 2023-11-11 04:56:07,679 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9dae779bcef447dca30022717ca52c31 2023-11-11 04:56:07,680 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/.tmp/family2/9dae779bcef447dca30022717ca52c31 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/9dae779bcef447dca30022717ca52c31 2023-11-11 04:56:07,683 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9dae779bcef447dca30022717ca52c31 2023-11-11 04:56:07,684 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 41418b6d675c8b4704b8e00a27d091fb/family2 of 41418b6d675c8b4704b8e00a27d091fb into 9dae779bcef447dca30022717ca52c31(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 04:56:07,684 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 41418b6d675c8b4704b8e00a27d091fb: 2023-11-11 04:56:07,684 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:56:07,684 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 03fa52e8eef4e3b415e3c16f3fbf695d/family1 is initiating major compaction (all files) 2023-11-11 04:56:07,684 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:56:07,685 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:56:07,685 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 03fa52e8eef4e3b415e3c16f3fbf695d/family1 in testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:07,685 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/6334ac5d84ae472e96eb0ef4ccef71a2, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f82fc82bca314f3f84698e496e147582, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/c25b1833a1a44b899478868e3e5ff1e5, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f71f2cac556346d3b0171084be599b1b, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/4a87db42d7624737b633869b77fd563b] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp, totalSize=27.1 K 2023-11-11 04:56:07,685 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 6334ac5d84ae472e96eb0ef4ccef71a2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678556334 2023-11-11 04:56:07,685 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting f82fc82bca314f3f84698e496e147582, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678557807 2023-11-11 04:56:07,686 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting c25b1833a1a44b899478868e3e5ff1e5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678559668 2023-11-11 04:56:07,686 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting f71f2cac556346d3b0171084be599b1b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678560744 2023-11-11 04:56:07,686 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 4a87db42d7624737b633869b77fd563b, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:56:07,694 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 03fa52e8eef4e3b415e3c16f3fbf695d#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:56:07,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/16453a14d9014d4098a253e3bd7c3307, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/d80579b3813b4396b4f0e38dd51154d6, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/c38edf74c9814b5f92e33bf3dd55b02a, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/82bd4225b3114e43a45c397aafa242fd, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/13898671fcd1447da3819d4b18369bd2] to archive 2023-11-11 04:56:07,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:07,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/16453a14d9014d4098a253e3bd7c3307 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/16453a14d9014d4098a253e3bd7c3307 2023-11-11 04:56:07,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/d80579b3813b4396b4f0e38dd51154d6 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/d80579b3813b4396b4f0e38dd51154d6 2023-11-11 04:56:07,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/c38edf74c9814b5f92e33bf3dd55b02a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/c38edf74c9814b5f92e33bf3dd55b02a 2023-11-11 04:56:07,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/82bd4225b3114e43a45c397aafa242fd to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/82bd4225b3114e43a45c397aafa242fd 2023-11-11 04:56:07,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/13898671fcd1447da3819d4b18369bd2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family2/13898671fcd1447da3819d4b18369bd2 2023-11-11 04:56:08,132 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111189c36bd00a874e03a84a0ba64ceecc57_del 2023-11-11 04:56:08,132 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111189c36bd00a874e03a84a0ba64ceecc57_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111189c36bd00a874e03a84a0ba64ceecc57_del 2023-11-11 04:56:08,985 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4226e3ba003c43aebca73849b95ef962 2023-11-11 04:56:08,985 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family1/4226e3ba003c43aebca73849b95ef962 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/4226e3ba003c43aebca73849b95ef962 2023-11-11 04:56:09,007 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4226e3ba003c43aebca73849b95ef962 2023-11-11 04:56:09,008 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 03fa52e8eef4e3b415e3c16f3fbf695d/family1 of 03fa52e8eef4e3b415e3c16f3fbf695d into 4226e3ba003c43aebca73849b95ef962(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:56:09,008 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 03fa52e8eef4e3b415e3c16f3fbf695d: 2023-11-11 04:56:09,008 DEBUG [Listener at localhost/35271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 04:56:09,009 DEBUG [Listener at localhost/35271] regionserver.HStore(1912): 03fa52e8eef4e3b415e3c16f3fbf695d/family2 is initiating major compaction (all files) 2023-11-11 04:56:09,009 INFO [Listener at localhost/35271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 04:56:09,009 INFO [Listener at localhost/35271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 04:56:09,009 INFO [Listener at localhost/35271] regionserver.HRegion(2259): Starting compaction of 03fa52e8eef4e3b415e3c16f3fbf695d/family2 in testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:09,009 INFO [Listener at localhost/35271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/7c8909991e6f4b4185ba99d486b9fd56, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2a9159fae445418cb09a006cd0f15679, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2efd1a30fa3245e0bc0b2c9d236af180, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/9b9b1558042e4ea9a4911a8daab70b0a, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/030a688fea4545278848e8e359ad3c55] into tmpdir=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp, totalSize=25.4 K 2023-11-11 04:56:09,009 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 7c8909991e6f4b4185ba99d486b9fd56, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699678556334 2023-11-11 04:56:09,010 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 2a9159fae445418cb09a006cd0f15679, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699678557807 2023-11-11 04:56:09,010 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 2efd1a30fa3245e0bc0b2c9d236af180, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699678559668 2023-11-11 04:56:09,010 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 9b9b1558042e4ea9a4911a8daab70b0a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699678560744 2023-11-11 04:56:09,011 DEBUG [Listener at localhost/35271] compactions.Compactor(207): Compacting 030a688fea4545278848e8e359ad3c55, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 04:56:09,018 INFO [Listener at localhost/35271] throttle.PressureAwareThroughputController(145): 03fa52e8eef4e3b415e3c16f3fbf695d#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 04:56:09,098 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/6334ac5d84ae472e96eb0ef4ccef71a2, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f82fc82bca314f3f84698e496e147582, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/c25b1833a1a44b899478868e3e5ff1e5, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f71f2cac556346d3b0171084be599b1b, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/4a87db42d7624737b633869b77fd563b] to archive 2023-11-11 04:56:09,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:09,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/6334ac5d84ae472e96eb0ef4ccef71a2 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/6334ac5d84ae472e96eb0ef4ccef71a2 2023-11-11 04:56:09,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f82fc82bca314f3f84698e496e147582 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f82fc82bca314f3f84698e496e147582 2023-11-11 04:56:09,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/c25b1833a1a44b899478868e3e5ff1e5 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/c25b1833a1a44b899478868e3e5ff1e5 2023-11-11 04:56:09,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f71f2cac556346d3b0171084be599b1b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/f71f2cac556346d3b0171084be599b1b 2023-11-11 04:56:09,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/4a87db42d7624737b633869b77fd563b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/4a87db42d7624737b633869b77fd563b 2023-11-11 04:56:09,425 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311113a1773ba521e4f4fa11ffe1cec0a5595_del 2023-11-11 04:56:09,425 INFO [Listener at localhost/35271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311113a1773ba521e4f4fa11ffe1cec0a5595_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311113a1773ba521e4f4fa11ffe1cec0a5595_del 2023-11-11 04:56:10,238 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b644ebb1dd244140a9171147c8477a8d 2023-11-11 04:56:10,238 DEBUG [Listener at localhost/35271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/.tmp/family2/b644ebb1dd244140a9171147c8477a8d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/b644ebb1dd244140a9171147c8477a8d 2023-11-11 04:56:10,241 INFO [Listener at localhost/35271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b644ebb1dd244140a9171147c8477a8d 2023-11-11 04:56:10,242 INFO [Listener at localhost/35271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 03fa52e8eef4e3b415e3c16f3fbf695d/family2 of 03fa52e8eef4e3b415e3c16f3fbf695d into b644ebb1dd244140a9171147c8477a8d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 04:56:10,242 DEBUG [Listener at localhost/35271] regionserver.HRegion(2289): Compaction status journal for 03fa52e8eef4e3b415e3c16f3fbf695d: 2023-11-11 04:56:10,246 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:56:10,249 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:56:10,252 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:56:10,253 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:56:10,258 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38667] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10(D\xFFl\xC3\xEE\xE2\x09\xBEe\xDA\x9Ar=\xFEz"\x10!us\xE8\x1F\xA2k\x15[Y|\x12\xC90Ek*\x10\x110\xC9\xAF\x08C\xE4\x9E=&%\xD2@\x1EYo2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-11 04:56:10,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-11 04:56:10,282 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-11 04:56:10,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:56:10,282 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699679170282 2023-11-11 04:56:10,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 04:56:10,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/7c8909991e6f4b4185ba99d486b9fd56, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2a9159fae445418cb09a006cd0f15679, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2efd1a30fa3245e0bc0b2c9d236af180, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/9b9b1558042e4ea9a4911a8daab70b0a, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/030a688fea4545278848e8e359ad3c55] to archive 2023-11-11 04:56:10,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:10,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/7c8909991e6f4b4185ba99d486b9fd56 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/7c8909991e6f4b4185ba99d486b9fd56 2023-11-11 04:56:10,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2a9159fae445418cb09a006cd0f15679 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2a9159fae445418cb09a006cd0f15679 2023-11-11 04:56:10,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2efd1a30fa3245e0bc0b2c9d236af180 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/2efd1a30fa3245e0bc0b2c9d236af180 2023-11-11 04:56:10,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/9b9b1558042e4ea9a4911a8daab70b0a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/9b9b1558042e4ea9a4911a8daab70b0a 2023-11-11 04:56:10,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/030a688fea4545278848e8e359ad3c55 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family2/030a688fea4545278848e8e359ad3c55 2023-11-11 04:56:10,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-11 04:56:10,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311114715d5fdb623441ba73c9e7f9fafa476_del 2023-11-11 04:56:10,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111189c36bd00a874e03a84a0ba64ceecc57_del 2023-11-11 04:56:10,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111fafbc77d1a3a499388359599081c58ad_del 2023-11-11 04:56:10,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 04:56:10,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] zookeeper.ReadOnlyZKClient(139): Connect 0x2417c8d0 to 127.0.0.1:61842 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 04:56:10,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@468c2c86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 04:56:10,730 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 04:56:11,693 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111f49fb1deb62b41f29f26a486d631b6ad to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111f49fb1deb62b41f29f26a486d631b6ad 2023-11-11 04:56:11,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 04:56:11,710 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 04:56:11,713 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 04:56:11,722 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 04:56:11,725 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 04:56:11,754 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231111/family1/27c63def8e8e4d998192f32a479e4951 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-11 04:56:11,755 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231111/family1/27c63def8e8e4d998192f32a479e4951}] 2023-11-11 04:56:11,760 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231111/family1/27c63def8e8e4d998192f32a479e4951 for inclusion in 94b83d298105b4a0a2b7001a2ac465ca/family1 2023-11-11 04:56:11,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-11 04:56:11,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-11 04:56:11,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 94b83d298105b4a0a2b7001a2ac465ca: 2023-11-11 04:56:11,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231111/family1/27c63def8e8e4d998192f32a479e4951 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__d8n7lsab1a0h7ppg2hqaoa43sib90k3j2s8c37ief9m3hg4fjeu871d464fhg1a6/family1/27c63def8e8e4d998192f32a479e4951 2023-11-11 04:56:11,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__d8n7lsab1a0h7ppg2hqaoa43sib90k3j2s8c37ief9m3hg4fjeu871d464fhg1a6/family1/27c63def8e8e4d998192f32a479e4951 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/6b25196a38c343fb8d92c3f533d0aa21_SeqId_28_ 2023-11-11 04:56:11,785 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__d8n7lsab1a0h7ppg2hqaoa43sib90k3j2s8c37ief9m3hg4fjeu871d464fhg1a6/family1/27c63def8e8e4d998192f32a479e4951 into 94b83d298105b4a0a2b7001a2ac465ca/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/6b25196a38c343fb8d92c3f533d0aa21_SeqId_28_ - updating store file list. 2023-11-11 04:56:11,807 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/6b25196a38c343fb8d92c3f533d0aa21_SeqId_28_ into 94b83d298105b4a0a2b7001a2ac465ca/family1 2023-11-11 04:56:11,807 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__d8n7lsab1a0h7ppg2hqaoa43sib90k3j2s8c37ief9m3hg4fjeu871d464fhg1a6/family1/27c63def8e8e4d998192f32a479e4951 into 94b83d298105b4a0a2b7001a2ac465ca/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/family1/6b25196a38c343fb8d92c3f533d0aa21_SeqId_28_) 2023-11-11 04:56:11,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__d8n7lsab1a0h7ppg2hqaoa43sib90k3j2s8c37ief9m3hg4fjeu871d464fhg1a6/family1/27c63def8e8e4d998192f32a479e4951 2023-11-11 04:56:11,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 04:56:11,811 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:11,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111178bb927e44d7469ca2880fe578ccacea to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111178bb927e44d7469ca2880fe578ccacea 2023-11-11 04:56:11,813 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311119e4cebf0a49046eea2769ddf6e25a211 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311119e4cebf0a49046eea2769ddf6e25a211 2023-11-11 04:56:11,814 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111b20688000bf446b3ae13ce4b039f9263 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111b20688000bf446b3ae13ce4b039f9263 2023-11-11 04:56:11,815 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111e460cd5f8fc6489d93d94d6789e1d485 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111e460cd5f8fc6489d93d94d6789e1d485 2023-11-11 04:56:11,815 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-11 04:56:11,815 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231111' 2023-11-11 04:56:11,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 04:56:11,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 04:56:11,985 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111175b0eed525d1462d8ead110065590b1b to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111175b0eed525d1462d8ead110065590b1b 2023-11-11 04:56:11,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 04:56:12,029 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231111/family1/690da94edb1041949b37e46c6d308545 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-11 04:56:12,030 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231111/family1/690da94edb1041949b37e46c6d308545}] 2023-11-11 04:56:12,032 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231111/family1/690da94edb1041949b37e46c6d308545 for inclusion in 03fa52e8eef4e3b415e3c16f3fbf695d/family1 2023-11-11 04:56:12,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-11 04:56:12,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-11 04:56:12,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 03fa52e8eef4e3b415e3c16f3fbf695d: 2023-11-11 04:56:12,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231111/family1/690da94edb1041949b37e46c6d308545 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__6mmpgjma6olv38nabajb77grfvrfhbas51fsrtogqh5uc00im2d6cfdmks018qek/family1/690da94edb1041949b37e46c6d308545 2023-11-11 04:56:12,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__6mmpgjma6olv38nabajb77grfvrfhbas51fsrtogqh5uc00im2d6cfdmks018qek/family1/690da94edb1041949b37e46c6d308545 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/cf9522ee45cb4aeab0ccbab645be1ba1_SeqId_28_ 2023-11-11 04:56:12,058 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__6mmpgjma6olv38nabajb77grfvrfhbas51fsrtogqh5uc00im2d6cfdmks018qek/family1/690da94edb1041949b37e46c6d308545 into 03fa52e8eef4e3b415e3c16f3fbf695d/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/cf9522ee45cb4aeab0ccbab645be1ba1_SeqId_28_ - updating store file list. 2023-11-11 04:56:12,082 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/cf9522ee45cb4aeab0ccbab645be1ba1_SeqId_28_ into 03fa52e8eef4e3b415e3c16f3fbf695d/family1 2023-11-11 04:56:12,082 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__6mmpgjma6olv38nabajb77grfvrfhbas51fsrtogqh5uc00im2d6cfdmks018qek/family1/690da94edb1041949b37e46c6d308545 into 03fa52e8eef4e3b415e3c16f3fbf695d/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/family1/cf9522ee45cb4aeab0ccbab645be1ba1_SeqId_28_) 2023-11-11 04:56:12,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__6mmpgjma6olv38nabajb77grfvrfhbas51fsrtogqh5uc00im2d6cfdmks018qek/family1/690da94edb1041949b37e46c6d308545 2023-11-11 04:56:12,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 04:56:12,085 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:12,086 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111129df72b7d461456896e01e3d8d3b3dcf to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111129df72b7d461456896e01e3d8d3b3dcf 2023-11-11 04:56:12,087 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311114b56f8e620634279bc90710f4081b318 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311114b56f8e620634279bc90710f4081b318 2023-11-11 04:56:12,088 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231111f4e48fbe8b6244c9926b0fa9e8cbfdcf to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231111f4e48fbe8b6244c9926b0fa9e8cbfdcf 2023-11-11 04:56:12,089 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231111feca1949111d488fbde106e688d39009 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231111feca1949111d488fbde106e688d39009 2023-11-11 04:56:12,089 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-11 04:56:12,089 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231111' 2023-11-11 04:56:12,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 04:56:12,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 04:56:12,644 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311111192f628b33f4d4393051c415698fc5a to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311111192f628b33f4d4393051c415698fc5a 2023-11-11 04:56:12,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 04:56:12,683 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231111/family1/8e17b58db6e04690a70a553892bf90dc first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-11 04:56:12,684 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb., hostname=jenkins-hbase4.apache.org,43941,1699678403879, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231111/family1/8e17b58db6e04690a70a553892bf90dc}] 2023-11-11 04:56:12,685 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(763): Validating hfile at hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231111/family1/8e17b58db6e04690a70a553892bf90dc for inclusion in 41418b6d675c8b4704b8e00a27d091fb/family1 2023-11-11 04:56:12,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-11 04:56:12,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(777): Region bounds: first= last=1 2023-11-11 04:56:12,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegion(2446): Flush status journal for 41418b6d675c8b4704b8e00a27d091fb: 2023-11-11 04:56:12,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231111/family1/8e17b58db6e04690a70a553892bf90dc to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__oakpn8ilpvtpmg0dbi6otpcq2plq9su5ecv69taat3seala562477qlu9aoakm37/family1/8e17b58db6e04690a70a553892bf90dc 2023-11-11 04:56:12,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__oakpn8ilpvtpmg0dbi6otpcq2plq9su5ecv69taat3seala562477qlu9aoakm37/family1/8e17b58db6e04690a70a553892bf90dc as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/685106303c4540d6a37a96973a578a66_SeqId_28_ 2023-11-11 04:56:12,709 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(849): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__oakpn8ilpvtpmg0dbi6otpcq2plq9su5ecv69taat3seala562477qlu9aoakm37/family1/8e17b58db6e04690a70a553892bf90dc into 41418b6d675c8b4704b8e00a27d091fb/family1 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/685106303c4540d6a37a96973a578a66_SeqId_28_ - updating store file list. 2023-11-11 04:56:12,742 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(882): Loaded HFile hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/685106303c4540d6a37a96973a578a66_SeqId_28_ into 41418b6d675c8b4704b8e00a27d091fb/family1 2023-11-11 04:56:12,742 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.HStore(855): Successfully loaded hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__oakpn8ilpvtpmg0dbi6otpcq2plq9su5ecv69taat3seala562477qlu9aoakm37/family1/8e17b58db6e04690a70a553892bf90dc into 41418b6d675c8b4704b8e00a27d091fb/family1 (new location: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/family1/685106303c4540d6a37a96973a578a66_SeqId_28_) 2023-11-11 04:56:12,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43941] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/staging/jenkins__testMajorCompactionFromAdmin__oakpn8ilpvtpmg0dbi6otpcq2plq9su5ecv69taat3seala562477qlu9aoakm37/family1/8e17b58db6e04690a70a553892bf90dc 2023-11-11 04:56:12,744 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 04:56:12,745 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:12,746 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311110778bd5079e1494cb7ecafa7e3313a1e to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311110778bd5079e1494cb7ecafa7e3313a1e 2023-11-11 04:56:12,747 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311113e65ee238256415b902fa5735adbadc0 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311113e65ee238256415b902fa5735adbadc0 2023-11-11 04:56:12,748 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111479f28036c8c4b91b0f9550c070ee812 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111479f28036c8c4b91b0f9550c070ee812 2023-11-11 04:56:12,749 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111d47db1a9d05e4c56aafab997fd457120 to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111d47db1a9d05e4c56aafab997fd457120 2023-11-11 04:56:12,749 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-11 04:56:12,749 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231111' 2023-11-11 04:56:12,750 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 04:56:12,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 04:56:12,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 04:56:12,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311114715d5fdb623441ba73c9e7f9fafa476_del] 2023-11-11 04:56:12,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:12,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311114715d5fdb623441ba73c9e7f9fafa476_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311114715d5fdb623441ba73c9e7f9fafa476_del 2023-11-11 04:56:12,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-11 04:56:12,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111189c36bd00a874e03a84a0ba64ceecc57_del] 2023-11-11 04:56:12,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:12,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111189c36bd00a874e03a84a0ba64ceecc57_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111189c36bd00a874e03a84a0ba64ceecc57_del 2023-11-11 04:56:12,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-11 04:56:12,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111fafbc77d1a3a499388359599081c58ad_del] 2023-11-11 04:56:12,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 04:56:12,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111fafbc77d1a3a499388359599081c58ad_del to hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111fafbc77d1a3a499388359599081c58ad_del 2023-11-11 04:56:12,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-11 04:56:12,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699678408180] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 04:56:12,757 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-11 04:56:12,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.4770 sec 2023-11-11 04:56:12,771 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:56:12,773 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:56:12,775 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 04:56:12,775 DEBUG [Listener at localhost/35271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 04:56:12,779 INFO [Listener at localhost/35271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 04:56:12,816 INFO [Listener at localhost/35271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=251 (was 264), OpenFileDescriptor=671 (was 688), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 204), ProcessCount=167 (was 167), AvailableMemoryMB=2390 (was 2397) 2023-11-11 04:56:12,817 DEBUG [Listener at localhost/35271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75a9267a to 127.0.0.1:61842 2023-11-11 04:56:12,817 DEBUG [Listener at localhost/35271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:56:12,817 INFO [Listener at localhost/35271] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-11 04:56:12,818 INFO [Listener at localhost/35271] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 04:56:12,818 DEBUG [Listener at localhost/35271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e51ea3b to 127.0.0.1:61842 2023-11-11 04:56:12,818 DEBUG [Listener at localhost/35271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:56:12,818 DEBUG [Listener at localhost/35271] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-11 04:56:12,819 DEBUG [Listener at localhost/35271] util.JVMClusterUtil(257): Found active master hash=936648499, stopped=false 2023-11-11 04:56:12,819 INFO [Listener at localhost/35271] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38667,1699678402647 2023-11-11 04:56:12,821 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-11 04:56:12,821 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-11 04:56:12,821 INFO [Listener at localhost/35271] procedure2.ProcedureExecutor(628): Stopping 2023-11-11 04:56:12,821 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 04:56:12,821 DEBUG [Listener at localhost/35271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12880aef to 127.0.0.1:61842 2023-11-11 04:56:12,822 DEBUG [Listener at localhost/35271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:56:12,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-11 04:56:12,822 INFO [Listener at localhost/35271] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43941,1699678403879' ***** 2023-11-11 04:56:12,822 INFO [Listener at localhost/35271] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-11 04:56:12,822 INFO [RS:0;jenkins-hbase4:43941] regionserver.HeapMemoryManager(220): Stopping 2023-11-11 04:56:12,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-11 04:56:12,822 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-11 04:56:12,822 INFO [RS:0;jenkins-hbase4:43941] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-11 04:56:12,822 INFO [RS:0;jenkins-hbase4:43941] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-11 04:56:12,823 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 94b83d298105b4a0a2b7001a2ac465ca 2023-11-11 04:56:12,823 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 9935958aa309b992cb5f336e4bc6f510 2023-11-11 04:56:12,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 94b83d298105b4a0a2b7001a2ac465ca, disabling compactions & flushes 2023-11-11 04:56:12,823 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:56:12,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 1373b9c69a7c6eb51a25925a8d2f6a76 2023-11-11 04:56:12,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 41418b6d675c8b4704b8e00a27d091fb 2023-11-11 04:56:12,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. after waiting 0 ms 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for a683db6842a4a91eb25a93c544f95aaa 2023-11-11 04:56:12,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for e382088a27118f8b8a8b885e5576caaf 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for d33048759c13f557d932f58e5b37d029 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for a36cd15569ca04bc0fc71a10e86f004a 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 00839ddd2f9a872eed900d298a42d55d 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 0137cb0f6ae4fdb8385e1c97257ced24 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 3b5411216f3882b858e02206c99a35d9 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 2e6918dc58f4aaaece8729bb59a834ed 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 33b07a4e052e234a667f8fd20a21a8a8 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 03fa52e8eef4e3b415e3c16f3fbf695d 2023-11-11 04:56:12,824 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 1c2f996c60d38ae9ae3e9427d010ada7 2023-11-11 04:56:12,825 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 56b66f90356641deea4e629f16f10396 2023-11-11 04:56:12,825 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 76461f05efc482fa7730ea065191b0d6 2023-11-11 04:56:12,825 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 4d006bc838d3353e4d8b7fad62c39f9d 2023-11-11 04:56:12,825 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:12,825 DEBUG [RS:0;jenkins-hbase4:43941] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68396791 to 127.0.0.1:61842 2023-11-11 04:56:12,825 DEBUG [RS:0;jenkins-hbase4:43941] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:56:12,825 INFO [RS:0;jenkins-hbase4:43941] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-11 04:56:12,825 INFO [RS:0;jenkins-hbase4:43941] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-11 04:56:12,825 INFO [RS:0;jenkins-hbase4:43941] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-11 04:56:12,826 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-11 04:56:12,826 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-11 04:56:12,826 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-11 04:56:12,826 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-11 04:56:12,826 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-11 04:56:12,826 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-11 04:56:12,826 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-11 04:56:12,826 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-11 04:56:12,827 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1504): Waiting on 00839ddd2f9a872eed900d298a42d55d, 0137cb0f6ae4fdb8385e1c97257ced24, 03fa52e8eef4e3b415e3c16f3fbf695d, 1373b9c69a7c6eb51a25925a8d2f6a76, 1588230740, 1c2f996c60d38ae9ae3e9427d010ada7, 2e6918dc58f4aaaece8729bb59a834ed, 33b07a4e052e234a667f8fd20a21a8a8, 3b5411216f3882b858e02206c99a35d9, 41418b6d675c8b4704b8e00a27d091fb, 4d006bc838d3353e4d8b7fad62c39f9d, 56b66f90356641deea4e629f16f10396, 76461f05efc482fa7730ea065191b0d6, 7ad6e1bf3c142f58e3a8231f44a6cb3e, 94b83d298105b4a0a2b7001a2ac465ca, 9935958aa309b992cb5f336e4bc6f510, a36cd15569ca04bc0fc71a10e86f004a, a683db6842a4a91eb25a93c544f95aaa, d33048759c13f557d932f58e5b37d029, e382088a27118f8b8a8b885e5576caaf, edd1396e4f13db5121a27e2b760689b0 2023-11-11 04:56:12,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/94b83d298105b4a0a2b7001a2ac465ca/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 04:56:12,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:12,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 94b83d298105b4a0a2b7001a2ac465ca: 2023-11-11 04:56:12,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1699678554185.94b83d298105b4a0a2b7001a2ac465ca. 2023-11-11 04:56:12,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9935958aa309b992cb5f336e4bc6f510, disabling compactions & flushes 2023-11-11 04:56:12,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:56:12,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:56:12,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. after waiting 0 ms 2023-11-11 04:56:12,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:56:12,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/9935958aa309b992cb5f336e4bc6f510/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 04:56:12,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:56:12,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9935958aa309b992cb5f336e4bc6f510: 2023-11-11 04:56:12,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1699678526762.9935958aa309b992cb5f336e4bc6f510. 2023-11-11 04:56:12,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing edd1396e4f13db5121a27e2b760689b0, disabling compactions & flushes 2023-11-11 04:56:12,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:56:12,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:56:12,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. after waiting 0 ms 2023-11-11 04:56:12,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:56:12,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/edd1396e4f13db5121a27e2b760689b0/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-11 04:56:12,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:56:12,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for edd1396e4f13db5121a27e2b760689b0: 2023-11-11 04:56:12,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1699678503216.edd1396e4f13db5121a27e2b760689b0. 2023-11-11 04:56:12,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1373b9c69a7c6eb51a25925a8d2f6a76, disabling compactions & flushes 2023-11-11 04:56:12,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:56:12,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:56:12,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. after waiting 0 ms 2023-11-11 04:56:12,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:56:12,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/1373b9c69a7c6eb51a25925a8d2f6a76/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-11 04:56:12,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:56:12,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1373b9c69a7c6eb51a25925a8d2f6a76: 2023-11-11 04:56:12,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1699678449434.1373b9c69a7c6eb51a25925a8d2f6a76. 2023-11-11 04:56:12,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 41418b6d675c8b4704b8e00a27d091fb, disabling compactions & flushes 2023-11-11 04:56:12,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:12,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:12,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. after waiting 0 ms 2023-11-11 04:56:12,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:12,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/41418b6d675c8b4704b8e00a27d091fb/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 04:56:12,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:12,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 41418b6d675c8b4704b8e00a27d091fb: 2023-11-11 04:56:12,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1699678554185.41418b6d675c8b4704b8e00a27d091fb. 2023-11-11 04:56:12,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a683db6842a4a91eb25a93c544f95aaa, disabling compactions & flushes 2023-11-11 04:56:12,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:56:12,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:56:12,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. after waiting 0 ms 2023-11-11 04:56:12,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:56:12,850 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-11 04:56:12,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a683db6842a4a91eb25a93c544f95aaa/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-11 04:56:12,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:56:12,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a683db6842a4a91eb25a93c544f95aaa: 2023-11-11 04:56:12,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699678466901.a683db6842a4a91eb25a93c544f95aaa. 2023-11-11 04:56:12,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e382088a27118f8b8a8b885e5576caaf, disabling compactions & flushes 2023-11-11 04:56:12,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:56:12,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:56:12,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. after waiting 0 ms 2023-11-11 04:56:12,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:56:12,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/e382088a27118f8b8a8b885e5576caaf/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-11 04:56:12,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:56:12,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e382088a27118f8b8a8b885e5576caaf: 2023-11-11 04:56:12,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699678481529.e382088a27118f8b8a8b885e5576caaf. 2023-11-11 04:56:12,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d33048759c13f557d932f58e5b37d029, disabling compactions & flushes 2023-11-11 04:56:12,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:56:12,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:56:12,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. after waiting 0 ms 2023-11-11 04:56:12,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:56:12,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/d33048759c13f557d932f58e5b37d029/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 04:56:12,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:56:12,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d33048759c13f557d932f58e5b37d029: 2023-11-11 04:56:12,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1699678526762.d33048759c13f557d932f58e5b37d029. 2023-11-11 04:56:12,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a36cd15569ca04bc0fc71a10e86f004a, disabling compactions & flushes 2023-11-11 04:56:12,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:56:12,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:56:12,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. after waiting 0 ms 2023-11-11 04:56:12,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:56:12,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithMonthlyPolicy/a36cd15569ca04bc0fc71a10e86f004a/recovered.edits/51.seqid, newMaxSeqId=51, maxSeqId=1 2023-11-11 04:56:12,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:56:12,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a36cd15569ca04bc0fc71a10e86f004a: 2023-11-11 04:56:12,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1699678544669.a36cd15569ca04bc0fc71a10e86f004a. 2023-11-11 04:56:12,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 00839ddd2f9a872eed900d298a42d55d, disabling compactions & flushes 2023-11-11 04:56:12,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:56:12,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:56:12,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. after waiting 0 ms 2023-11-11 04:56:12,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:56:12,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/00839ddd2f9a872eed900d298a42d55d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-11 04:56:12,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:56:12,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 00839ddd2f9a872eed900d298a42d55d: 2023-11-11 04:56:12,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1699678449434.00839ddd2f9a872eed900d298a42d55d. 2023-11-11 04:56:12,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0137cb0f6ae4fdb8385e1c97257ced24, disabling compactions & flushes 2023-11-11 04:56:12,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:56:12,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:56:12,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. after waiting 0 ms 2023-11-11 04:56:12,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:56:12,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0137cb0f6ae4fdb8385e1c97257ced24 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-11 04:56:12,905 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-11 04:56:13,027 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1504): Waiting on 0137cb0f6ae4fdb8385e1c97257ced24, 03fa52e8eef4e3b415e3c16f3fbf695d, 1588230740, 1c2f996c60d38ae9ae3e9427d010ada7, 2e6918dc58f4aaaece8729bb59a834ed, 33b07a4e052e234a667f8fd20a21a8a8, 3b5411216f3882b858e02206c99a35d9, 4d006bc838d3353e4d8b7fad62c39f9d, 56b66f90356641deea4e629f16f10396, 76461f05efc482fa7730ea065191b0d6, 7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:56:13,227 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1504): Waiting on 0137cb0f6ae4fdb8385e1c97257ced24, 03fa52e8eef4e3b415e3c16f3fbf695d, 1588230740, 1c2f996c60d38ae9ae3e9427d010ada7, 2e6918dc58f4aaaece8729bb59a834ed, 33b07a4e052e234a667f8fd20a21a8a8, 3b5411216f3882b858e02206c99a35d9, 4d006bc838d3353e4d8b7fad62c39f9d, 56b66f90356641deea4e629f16f10396, 76461f05efc482fa7730ea065191b0d6, 7ad6e1bf3c142f58e3a8231f44a6cb3e 2023-11-11 04:56:13,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/.tmp/info/241f583b106848febd5925220201c835 2023-11-11 04:56:13,242 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 241f583b106848febd5925220201c835 2023-11-11 04:56:13,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24/.tmp/info/3544951a9d794462aeb4c2f91b0e580d 2023-11-11 04:56:13,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24/.tmp/info/3544951a9d794462aeb4c2f91b0e580d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24/info/3544951a9d794462aeb4c2f91b0e580d 2023-11-11 04:56:13,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24/info/3544951a9d794462aeb4c2f91b0e580d, entries=3, sequenceid=7, filesize=4.8 K 2023-11-11 04:56:13,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 0137cb0f6ae4fdb8385e1c97257ced24 in 420ms, sequenceid=7, compaction requested=false 2023-11-11 04:56:13,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/namespace/0137cb0f6ae4fdb8385e1c97257ced24/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-11 04:56:13,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:56:13,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0137cb0f6ae4fdb8385e1c97257ced24: 2023-11-11 04:56:13,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1699678407036.0137cb0f6ae4fdb8385e1c97257ced24. 2023-11-11 04:56:13,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3b5411216f3882b858e02206c99a35d9, disabling compactions & flushes 2023-11-11 04:56:13,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:56:13,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:56:13,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. after waiting 0 ms 2023-11-11 04:56:13,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:56:13,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3b5411216f3882b858e02206c99a35d9/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-11 04:56:13,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:56:13,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3b5411216f3882b858e02206c99a35d9: 2023-11-11 04:56:13,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699678408378.3b5411216f3882b858e02206c99a35d9. 2023-11-11 04:56:13,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ad6e1bf3c142f58e3a8231f44a6cb3e, disabling compactions & flushes 2023-11-11 04:56:13,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:56:13,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:56:13,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. after waiting 0 ms 2023-11-11 04:56:13,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:56:13,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testScannerOnBulkLoadRefHFiles/7ad6e1bf3c142f58e3a8231f44a6cb3e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-11 04:56:13,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:56:13,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ad6e1bf3c142f58e3a8231f44a6cb3e: 2023-11-11 04:56:13,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1699678449434.7ad6e1bf3c142f58e3a8231f44a6cb3e. 2023-11-11 04:56:13,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2e6918dc58f4aaaece8729bb59a834ed, disabling compactions & flushes 2023-11-11 04:56:13,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:56:13,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:56:13,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. after waiting 0 ms 2023-11-11 04:56:13,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:56:13,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/2e6918dc58f4aaaece8729bb59a834ed/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-11 04:56:13,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:56:13,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2e6918dc58f4aaaece8729bb59a834ed: 2023-11-11 04:56:13,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1699678503216.2e6918dc58f4aaaece8729bb59a834ed. 2023-11-11 04:56:13,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 33b07a4e052e234a667f8fd20a21a8a8, disabling compactions & flushes 2023-11-11 04:56:13,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:56:13,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:56:13,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. after waiting 0 ms 2023-11-11 04:56:13,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:56:13,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testCompactionWithHFileLink/33b07a4e052e234a667f8fd20a21a8a8/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-11 04:56:13,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:56:13,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 33b07a4e052e234a667f8fd20a21a8a8: 2023-11-11 04:56:13,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1699678503216.33b07a4e052e234a667f8fd20a21a8a8. 2023-11-11 04:56:13,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 03fa52e8eef4e3b415e3c16f3fbf695d, disabling compactions & flushes 2023-11-11 04:56:13,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:13,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:13,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. after waiting 0 ms 2023-11-11 04:56:13,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:13,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionFromAdmin/03fa52e8eef4e3b415e3c16f3fbf695d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 04:56:13,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:13,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 03fa52e8eef4e3b415e3c16f3fbf695d: 2023-11-11 04:56:13,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1699678554185.03fa52e8eef4e3b415e3c16f3fbf695d. 2023-11-11 04:56:13,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1c2f996c60d38ae9ae3e9427d010ada7, disabling compactions & flushes 2023-11-11 04:56:13,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:56:13,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:56:13,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. after waiting 0 ms 2023-11-11 04:56:13,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:56:13,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithWeeklyPolicy/1c2f996c60d38ae9ae3e9427d010ada7/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-11 04:56:13,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:56:13,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1c2f996c60d38ae9ae3e9427d010ada7: 2023-11-11 04:56:13,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1699678454036.1c2f996c60d38ae9ae3e9427d010ada7. 2023-11-11 04:56:13,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 56b66f90356641deea4e629f16f10396, disabling compactions & flushes 2023-11-11 04:56:13,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:56:13,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:56:13,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. after waiting 0 ms 2023-11-11 04:56:13,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:56:13,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMinorCompactionWithWeeklyPolicy/56b66f90356641deea4e629f16f10396/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-11 04:56:13,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:56:13,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 56b66f90356641deea4e629f16f10396: 2023-11-11 04:56:13,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1699678436543.56b66f90356641deea4e629f16f10396. 2023-11-11 04:56:13,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 76461f05efc482fa7730ea065191b0d6, disabling compactions & flushes 2023-11-11 04:56:13,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:56:13,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:56:13,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. after waiting 0 ms 2023-11-11 04:56:13,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:56:13,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/default/testMajorCompactionWithMonthlyPolicy/76461f05efc482fa7730ea065191b0d6/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-11 04:56:13,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:56:13,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 76461f05efc482fa7730ea065191b0d6: 2023-11-11 04:56:13,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1699678422824.76461f05efc482fa7730ea065191b0d6. 2023-11-11 04:56:13,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4d006bc838d3353e4d8b7fad62c39f9d, disabling compactions & flushes 2023-11-11 04:56:13,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:56:13,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:56:13,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. after waiting 0 ms 2023-11-11 04:56:13,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:56:13,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/ns/testMinorCompaction/4d006bc838d3353e4d8b7fad62c39f9d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 04:56:13,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:56:13,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4d006bc838d3353e4d8b7fad62c39f9d: 2023-11-11 04:56:13,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1699678526762.4d006bc838d3353e4d8b7fad62c39f9d. 2023-11-11 04:56:13,428 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-11 04:56:13,617 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-11 04:56:13,617 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-11 04:56:13,628 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-11 04:56:13,648 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/.tmp/rep_barrier/98e46ed1e54b4694a6a2b48476f3873b 2023-11-11 04:56:13,653 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98e46ed1e54b4694a6a2b48476f3873b 2023-11-11 04:56:13,828 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-11-11 04:56:13,829 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-11-11 04:56:13,829 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-11 04:56:14,029 DEBUG [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-11 04:56:14,060 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/.tmp/table/a8c2c73d0ce541bea4e58acba545ff5d 2023-11-11 04:56:14,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8c2c73d0ce541bea4e58acba545ff5d 2023-11-11 04:56:14,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/.tmp/info/241f583b106848febd5925220201c835 as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/info/241f583b106848febd5925220201c835 2023-11-11 04:56:14,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 241f583b106848febd5925220201c835 2023-11-11 04:56:14,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/info/241f583b106848febd5925220201c835, entries=226, sequenceid=130, filesize=37.9 K 2023-11-11 04:56:14,070 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/.tmp/rep_barrier/98e46ed1e54b4694a6a2b48476f3873b as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/rep_barrier/98e46ed1e54b4694a6a2b48476f3873b 2023-11-11 04:56:14,073 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98e46ed1e54b4694a6a2b48476f3873b 2023-11-11 04:56:14,073 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/rep_barrier/98e46ed1e54b4694a6a2b48476f3873b, entries=1, sequenceid=130, filesize=5.0 K 2023-11-11 04:56:14,074 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/.tmp/table/a8c2c73d0ce541bea4e58acba545ff5d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/table/a8c2c73d0ce541bea4e58acba545ff5d 2023-11-11 04:56:14,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8c2c73d0ce541bea4e58acba545ff5d 2023-11-11 04:56:14,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/table/a8c2c73d0ce541bea4e58acba545ff5d, entries=27, sequenceid=130, filesize=6.6 K 2023-11-11 04:56:14,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1253ms, sequenceid=130, compaction requested=false 2023-11-11 04:56:14,083 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-11 04:56:14,083 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-11 04:56:14,083 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-11 04:56:14,083 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-11 04:56:14,084 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-11 04:56:14,229 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43941,1699678403879; all regions closed. 2023-11-11 04:56:14,238 DEBUG [RS:0;jenkins-hbase4:43941] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/oldWALs 2023-11-11 04:56:14,238 INFO [RS:0;jenkins-hbase4:43941] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43941%2C1699678403879.meta:.meta(num 1699678406760) 2023-11-11 04:56:14,242 DEBUG [RS:0;jenkins-hbase4:43941] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/oldWALs 2023-11-11 04:56:14,242 INFO [RS:0;jenkins-hbase4:43941] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43941%2C1699678403879:(num 1699678405777) 2023-11-11 04:56:14,242 DEBUG [RS:0;jenkins-hbase4:43941] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:56:14,242 INFO [RS:0;jenkins-hbase4:43941] regionserver.LeaseManager(133): Closed leases 2023-11-11 04:56:14,242 INFO [RS:0;jenkins-hbase4:43941] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-11 04:56:14,242 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-11 04:56:14,243 INFO [RS:0;jenkins-hbase4:43941] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43941 2023-11-11 04:56:14,251 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43941,1699678403879 2023-11-11 04:56:14,251 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-11 04:56:14,251 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-11 04:56:14,253 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43941,1699678403879] 2023-11-11 04:56:14,253 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43941,1699678403879; numProcessing=1 2023-11-11 04:56:14,254 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43941,1699678403879 already deleted, retry=false 2023-11-11 04:56:14,255 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,43941,1699678403879 expired; onlineServers=0 2023-11-11 04:56:14,255 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38667,1699678402647' ***** 2023-11-11 04:56:14,255 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-11 04:56:14,255 DEBUG [M:0;jenkins-hbase4:38667] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76e91508, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-11 04:56:14,255 INFO [M:0;jenkins-hbase4:38667] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38667,1699678402647 2023-11-11 04:56:14,255 INFO [M:0;jenkins-hbase4:38667] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38667,1699678402647; all regions closed. 2023-11-11 04:56:14,255 DEBUG [M:0;jenkins-hbase4:38667] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 04:56:14,255 DEBUG [M:0;jenkins-hbase4:38667] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-11 04:56:14,255 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-11 04:56:14,255 DEBUG [M:0;jenkins-hbase4:38667] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-11 04:56:14,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699678405491] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699678405491,5,FailOnTimeoutGroup] 2023-11-11 04:56:14,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699678405493] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699678405493,5,FailOnTimeoutGroup] 2023-11-11 04:56:14,256 INFO [M:0;jenkins-hbase4:38667] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-11 04:56:14,256 INFO [M:0;jenkins-hbase4:38667] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-11 04:56:14,256 INFO [M:0;jenkins-hbase4:38667] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-11 04:56:14,256 DEBUG [M:0;jenkins-hbase4:38667] master.HMaster(1512): Stopping service threads 2023-11-11 04:56:14,256 INFO [M:0;jenkins-hbase4:38667] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-11 04:56:14,257 ERROR [M:0;jenkins-hbase4:38667] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-11 04:56:14,257 INFO [M:0;jenkins-hbase4:38667] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-11 04:56:14,257 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-11 04:56:14,258 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-11 04:56:14,258 DEBUG [M:0;jenkins-hbase4:38667] zookeeper.ZKUtil(398): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-11 04:56:14,258 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 04:56:14,258 WARN [M:0;jenkins-hbase4:38667] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-11 04:56:14,258 INFO [M:0;jenkins-hbase4:38667] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-11 04:56:14,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-11 04:56:14,258 INFO [M:0;jenkins-hbase4:38667] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-11 04:56:14,258 DEBUG [M:0;jenkins-hbase4:38667] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-11 04:56:14,258 INFO [M:0;jenkins-hbase4:38667] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 04:56:14,258 DEBUG [M:0;jenkins-hbase4:38667] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 04:56:14,258 DEBUG [M:0;jenkins-hbase4:38667] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-11 04:56:14,259 DEBUG [M:0;jenkins-hbase4:38667] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 04:56:14,259 INFO [M:0;jenkins-hbase4:38667] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.95 KB heapSize=599.15 KB 2023-11-11 04:56:14,353 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-11 04:56:14,353 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): regionserver:43941-0x101d3796c880001, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-11 04:56:14,353 INFO [RS:0;jenkins-hbase4:43941] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43941,1699678403879; zookeeper connection closed. 2023-11-11 04:56:14,353 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@36cca65d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@36cca65d 2023-11-11 04:56:14,354 INFO [Listener at localhost/35271] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-11 04:56:14,666 INFO [M:0;jenkins-hbase4:38667] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.95 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bbc36875b4f8416b8a526c86bcba244d 2023-11-11 04:56:14,669 INFO [M:0;jenkins-hbase4:38667] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbc36875b4f8416b8a526c86bcba244d 2023-11-11 04:56:14,670 DEBUG [M:0;jenkins-hbase4:38667] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bbc36875b4f8416b8a526c86bcba244d as hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bbc36875b4f8416b8a526c86bcba244d 2023-11-11 04:56:14,673 INFO [M:0;jenkins-hbase4:38667] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbc36875b4f8416b8a526c86bcba244d 2023-11-11 04:56:14,673 INFO [M:0;jenkins-hbase4:38667] regionserver.HStore(1080): Added hdfs://localhost:44941/user/jenkins/test-data/61809c46-9d09-03b5-1cc7-361b75e34549/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bbc36875b4f8416b8a526c86bcba244d, entries=123, sequenceid=1011, filesize=33.3 K 2023-11-11 04:56:14,674 INFO [M:0;jenkins-hbase4:38667] regionserver.HRegion(2948): Finished flush of dataSize ~512.95 KB/525262, heapSize ~599.13 KB/613512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 415ms, sequenceid=1011, compaction requested=false 2023-11-11 04:56:14,674 INFO [M:0;jenkins-hbase4:38667] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 04:56:14,674 DEBUG [M:0;jenkins-hbase4:38667] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-11 04:56:14,677 INFO [M:0;jenkins-hbase4:38667] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-11 04:56:14,677 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-11 04:56:14,678 INFO [M:0;jenkins-hbase4:38667] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38667 2023-11-11 04:56:14,680 DEBUG [M:0;jenkins-hbase4:38667] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38667,1699678402647 already deleted, retry=false 2023-11-11 04:56:14,782 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-11 04:56:14,782 INFO [M:0;jenkins-hbase4:38667] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38667,1699678402647; zookeeper connection closed. 2023-11-11 04:56:14,782 DEBUG [Listener at localhost/35271-EventThread] zookeeper.ZKWatcher(600): master:38667-0x101d3796c880000, quorum=127.0.0.1:61842, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-11 04:56:14,784 WARN [Listener at localhost/35271] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-11 04:56:14,788 INFO [Listener at localhost/35271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-11 04:56:14,895 WARN [BP-1378495645-172.31.14.131-1699678399109 heartbeating to localhost/127.0.0.1:44941] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-11 04:56:14,896 WARN [BP-1378495645-172.31.14.131-1699678399109 heartbeating to localhost/127.0.0.1:44941] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1378495645-172.31.14.131-1699678399109 (Datanode Uuid ca1c889f-8459-4f27-b8da-dcf0375e1cfd) service to localhost/127.0.0.1:44941 2023-11-11 04:56:14,898 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/cluster_4ad29b40-445f-1468-05dc-b255cb81bdb5/dfs/data/data1/current/BP-1378495645-172.31.14.131-1699678399109] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-11 04:56:14,898 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/4eb5a692-bb0f-2777-1017-babcf15bbf22/cluster_4ad29b40-445f-1468-05dc-b255cb81bdb5/dfs/data/data2/current/BP-1378495645-172.31.14.131-1699678399109] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-11 04:56:14,926 INFO [Listener at localhost/35271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-11 04:56:15,059 INFO [Listener at localhost/35271] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-11 04:56:15,140 INFO [Listener at localhost/35271] hbase.HBaseTestingUtility(1293): Minicluster is down